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ABSTRACT 



This study examines the distribution of applicants 
for small grants, the consequences of being funded, and the 
processing of proposals. The sample included every applicant 
submitting a proposal in fiscal 1968. The following data were 
collected: 1) questionnaires from applicants, both funded and not 

funded; 2) factual material from proposals submitted; 3) 
questionnaires from field readers; 4) field reader ratings of 
proposals and funding recommendations; 5) interviews with the 
Directors of Educational Research at the nine regional offices. The 
report is organized according to the life-history of a research 
project — from submission of the research plan through dissemination 
of the findings. Chapter headings are 1) the applicant and his 
institution, 2) the successful applicant, 3) the proposal, 4) 
developing the proposal, 5) processing the proposal, 6) effects of 
the research, 7) appraisal of the program, and 8) conclusions and 
recommendations. A major conclusion is that the Regional Research 
Program is successful in its goal of identifying and supporting less 
established researchers. (Appendixes contain a comparison of 
respondents and non-respondents to the applicant questionnaire and 
the field reader questionnaire, tables not included in the body of 
the report, the questionnaires, and the codebook containing the 
frequency distribution of responses to each item.) (Author/RT) 
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EREFATORI NOTE 



This report on the small-project grants administered under the 
Regional Research Program of the U, S, Office of Education is based on 
data obtained from applicants submitting prcposals for grants, the field, 
readers reviewing these proposals, and the Directors of Educational 
Research responsible for implementing the Program within the nine regions 
(now ten) of the Department of Health, Education, and Welfare. All of 
these individuals have contributed generously to this effort. The data 
cover Fiscal Year I968 (July, I967 through June, I968); however, experi- 
ences extending to the end of the survey (May, 1970 ) are also reported. 
Whenever appropriate, the analysis specifies these time distinctions. 

The findings are applicable to the circmstances existing in fiscal I968 
and to this sample of respondents. 

The reader should bear in mind that the report treats the regions 
as a xjhole, even though conditions for implementing the Program may vary 
from region to region. Each Director faces a particular set of local 
considerations and as a consequence the statements in the report do not 
apply uniformly to each region. Similarly, it would be surprising if 
the Directors agreed with every one of our interpretations. Where we 
are aware of differences in points of view, we note them in the text. 

The conclusions and recommendations are completely those of the authors. 



SUMimi 



Backp;roun.d 



To facilitate contact between applicants for small research grants 
and the U.S. Office of Education, the Regional Research Program (RRP) 
was established in September, 1966. Within a year, offices were operat- 
ing vjithin each of the nine regions'^ across the country to award grants 
for small-project research. The researcher interested in studying an 
educational problem submits a proposal to the regional office in his 
geographic area. His request for ISOE support must not exceed ^10,000, 
and the project must be completed vjithin eighteen months. 

The specific objectives of the Program are: 

1. To support significant, small-scale educational 
research projects. 

2. To facilitate participation in educational research 
by a broad range of college and university personnel. 

3. To encourage small colleges to undertake research 
programs so that students may benefit from having 
professors who are engaged in educational research 
activities. 

i;. To provide for direct and expeditious handling of 
proposals.*^ 



Objectives and Procedures of This Study 

In the summer of 1968 the Bureau of Applied Social Research, 
Columbia University was ai^arded a contract by the U.S. Office of Educa- 
tion to study the effects of the RRP. In particular, this research x-jas 
designed to examine the Program -vri-th respect to: (l) the distribution 

of applicants for small grants; (2) the consequences of being funded; 
and ( 3 ) the processing of proposals. 



tenth office was opened September l5, 1970. 

2 

Regional Project Research Guidelines for Preparing a Proposal , 
Bujreau of Research, Regional Research Program of the Office of Education, 
U.S. Department of Heailth, Education, and Welfare (March, I 969 ), p. 1. 
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The follov;ing data have been collected; 

1, Questionnaires from 66^ applicants who submitted 
proposals in Fiscal 1968. (Return rate v/as 78 per 
cent, ) 

2. Factual material from all proposals submitted in 
Fiscal 1968 , 

3» Questionnaires from 1|23 field readers who reviewed 
the proposals submitted in Fiscal 1968, (Return 
rate was 8^ per cent . ) 

I 4 ., Field reader ratings of proposals and funding recom- 
mendations. 

Interviews with the Directors of Educational Research 
at the nine regional offices. 

Findings^ 

A, Applicants and Their Proposals 

1. In the main, researchers applying to the RRP are young. Three 
out of ten are students, most of -vdicm are studying for a Ph.D. Of the 
applicants who have earned a doctorate, nearly half (I4.3 per cent) re- 
ceived it since 196h. Two-thirds of the employed applicants are faculty 
members of a college or university; the highest proportion of these are 
assistant professors. 

2. Although a high nmber of applicants specialize in education (5I; 
per cent), almost as many (1|5 per cent) are in disciplines--fairly strong 
evidence that the Program attracts applicants with a broad range of 
interests in research on the educational implications of -their disciplines 

3. Thirty-eight per cent of the applicants were funded. 

Applicants with either a master's degree or a doctorate in a 
discipline are equally likely to be funded. In addition, they are more 
likely to be funded tiian applicants with comparable degrees whose 
specialty is education, suggesting that the talented researcher is re- 
cruited to education rather than trained in education. 

The Program funds the less experienced rese.archer. Both pre- 
and post-doctoral applicants who have never received a research grant 



^The findings are based on the respondents. A comparison of respon- 
dents and non-respondents t'O' the' applicant questionnaire and to the 
field reader questionnaire is presented in Appendix A. 
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are more likely to be funded than the ones v:ho have previously been 
awarded a grant or tuo. Moreover, among applicants from a discipline 
who have never received a grant, the pre-doctoral applicant has as. much 
chance of being funded as the post-doctoral one. (Fifty-foixr per cent 
of these pre-doctora]. applicants and ^2 per cent of these post-doctoral 
ones are funded. ) 

6. Applicants whose major field is psychology are more frequently 
funded than those in ciny other field. >&thin psychology, it is the 
applicant specializing in learning or development viio is most likely to 
obtain funds per cent), 

7. A review of the proposals shows that 30 per cent have psychology 
as their subject mjatter; 27 per cent, education; and the remaining l\3 per 
cent include a nu^iber of subjects extending from art through zoology. 



8, Taken together, the elementary and secondary levels are of 
greatest interest; less than 10 per cent focus on pre-school. Students 
are the most popular object of research, and outside of the few (lij, per 
cent) who study teachers, almost no one plans to study participants in 
the educational process other than students, 

9. Many applicants fail to specify adequately the research pro- 
cedures of their proposed projects. For example, one-third who plan to 
study students do not indicate even an approx±nate sample size; one- 
fourth of the applicants neglect to state how they expect to analyze the 
data; and one-third do not specify how they >rill process the data. 

10. Applicants who intend their projects for doctoral dissertations 
are less likely than other applicants to request the maximum amount of 
federal support, 

11. Professional salaries are the major budget expense. 

12. Tilhen preparing proposals, most applicants have access to the 

USOE Guidelines and to a resource person knowledgeable about seeking 
research funds. However, less than one-half have other types of resources 
available' at their institutions such as: copies of previously submitted 

proposals, sample application forms from funding agencies, or ERIC (Edu- 
cational Resources Information Center) materials. The likelihood of being 
funded appears to be related more to the type and number of such resources 
available to the applicant than to i-iiich resources or how man 3 '' he uses. 
Whether an applicant uses a particular resource depends on a number of 
factors, possibly his research training, his experience in 'writing pro- 
posals, or the stage of his research plan* The important factor is the 
availability of resources. The 'wider the range of choice, the greater 
the opportunity for the researcher to select those appropriate to his 
needs. 



13. Applicants who have well-defined research plans compatible 
viith the Program guidelines before they think of applying to the Program 




11 



are more likely to be funded than those who develop plans after they 
decide to apply. This auggeete that the Program provides support for 
promising research ideas waiting to be tested. Without the Program's 
support these ideas might remain in the mind of the researcher — and^ in 
a sense, become lost knowledge, 

lii. Typically, the applicant's source of information about the 
Program is a colleague or superior. 

15. Applicants are critical of the length of time it took to 
process their proposals. The delay was due largely to understaffing and 
budget freezes v;hich plagued Fiscal 1968, the year of this study, and 
which continue to hamper the operation of the Program. In fact, the 
Program has yet to have a normal year, 

16. The negative consequences of budget freezes go beyond pro- 
tracted processing of applicant proposals. The freezes prevent the 
Directors of Educational Research from traveling to institutions in 
their regions and may alter proposal processing, Miniinal staffing in the 
regional offices impedes the general office work and communication 
between the regional offices and applicants. 

17 . Not funded applicants in some regions criticize the perfunctory 
vjay that they were informed of the granting decision. After spending 
time preparing a proposal, they were sent only a short form letter. Not 
funded applicants in other regions received an e^iplanation of the decision 
and commented on how helpful it had been, 

18. An alternative t-iay to explain the granting decision to appli- 
cants is to transmit field reader comments directly to them. Five out 
of six applicants, whether fundrd or not, favor this method of feedback, 
as do four out of five field readers. Although the viewpoints of the 
Directors diverge on this topic, those who have not adopted the practice 
are Tjilling to give it consideration. 

19 . The utilization and dissemination of research findings from 
funded projects is considerable. Six out of seven researchers discuss 
their projects in class; about half present their projects at departmental 
seminars; 67 per cent prepare (or will prepare) papers for professional 
meetings; and -72 per cent, manuscripts for publication, 

20. Student researchers who intend their projects for dissertations 
are a particularly interesting group. They are more likely than non- 
students to recommend course or curriculum changes, to plan to publish 
the results of their projects, and to report that their interest in 
research on education has been strengthened as a result of their projects 
— evidence that the Program's investment in the less experienced research- 
er pays off, 

21. Funded applicants who are also advisors for doctoral disserta- 
tions have student assistants on their projects. Four out of five of 
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these (funded) applicants anticipate that these students mil do fiurther 
research, 

B, Field Readers 

22, Field readers and the Directors of the Program overwhelmingly 
agree that the panel system for revieX'dng proposals is superior to obtain- 
ing revievjs by correspondence, 

23* Field readers have suggestions for changing the Field Reader 
Evaluation Form, A majority would separate the criterion ’’adequacy of 
personnel and facilities into two criteria, "adequacy of personnel" and 
"adequacy of facilities," An equally large number think a rating scale 
should be provided for evaluating each of the four criteria: educational 

significance, soimdness of research desigi .. adequacy of personnel and 
facilities, and economic efficiency, 

2h* in their assessment of the Program, field readers indicate that 
they value the ejqjosure to new research ideas and the intellectual stimu- 
lation that result from reviewing proposals. They are disappointed, how- 
ever, Tjith the limited contact they have mth the Program; the lack of 
feedback on proposals they evaluate; the amount of remuneration; and the 
time lapse betvreen review of a proposal and payment. 



C, Opinions of Applicants, Field Readers and 
Directors of Educational Research 

2^, Most applicants and field readers agree that the present 
^10,000 ceiling on individual projects should be raised. They favor a 
ceiling closer to $l5,000. The Directors have different points of view. 
One advocates retaining the present ceiling; another thinks there should 
be none; X'diile several others favor a sliding scale with provision for 
varying levels of support. In general, these Directors think it is ap~ 
propriate to support established researchers at a higher level than doc- 
toral Candida t e s , 

26, Only the Directors of the Program have a clear impression of 
the Program's policies and practices. Many applicants and field readers 
do not know whether the Program supports a broad or a narrow range of 
interests in education, vjhether it tends to be orthodox or venturesome in 
its support of research, or whether it is fairly strict or lenient in 
alloxdng departures from the research plans stated in proposals. 



Conclusions and Recommendations 



The major conclusion of this study is that the USOE Regional Research 
Program, committed as it is to developing research on education, is 
achieving one of its prime objectives. This does not mean, however, that 
the Program is without fault. Indeed, having studied the Program from 
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several perspectives, we offer ten recommendations for improving it. More- 
over, it is important for these recommendations to be implemented in the 
near future or a good program will be undermined. 

These recommendations are : 

1. The administrative budget for the Directors of Educa- 
tional Research should be stabilized. 

2. The research budget for small-project grants should 
be increased. 

3. The $10,000 ceiling for indi’/idual projects should 
be raised to $l5,000 plus overhead. 

i;. The panel method of reviex^ should be continued. 

5. Applicants should be notified of the status of their 
proposals within sixty days of submission. 

6. Field reader comments should be sent to every appli- 
cant . 

7. The Directors of Educational Research should offer 
direction to institutions in the selection of mate- 
rials to expand their resources for developing 
proposals. 

8. The Directors of Educational Research should increase 
their communication with both applicants and field . 
readers. 

9. The Guidelines for preparing the proposal document 
should be revised. 

10. Periodic summaries of applicant and proposal data 
should be compiled. 
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INTRODUCTION 



The Regional Research Program is close to 
the action ••• geography is not irrelevant. 
Investigators must have some place to turn 
vjith their unsolicited, proposals. 

Field Reader 

The vjhole idea of regionalization is excit- 
ing, Washington is frightening to so many 
people. They [applicants] don't know which 
door to knock on. 



USOE Staff Member 

The [Regional Research] Program gave me a 
chance to get off the ground. 

Funded Applicant 

These three persons vievr the Regional Research Progrs.m of the 
U.S. Office of Education as filling a research need. They all know 
that seeking funds for research is no simple task. The prospective 
researcher must find out which agencies support research in his field, 
comprehend the eligibility requirements, obtain application fonris and 
instructions, and then prepare a proposal, budget, and time schedule 
that can compete mth an unknom number of others. The individual idio 
at one time believed that he had a researchable problem can easily lose 
sight of that goal as the process of applying consumes his energy. 

To facilitate contact between an applicant and a granting agency, 
the U.S, Office of Education established the Regional Research Program 
(RRP) in September, 1966, By September, 1967, an office had been opened 
in each of the nine existing DHEVJ (U.S. Department of Health, Education, 
and Welfare) regions^ across the coiintry to award contracts for small- 
project research. To participate, the researcher submits a proposal 
for educational research to the regional office in his geographic area. 
There are two fundamental requirements: (l) IBOE support must not 

exceed $10,000; and (2) the project must be completed vdthin eighteen 
months , 



tenth office >ra.s opened September l5, 1970, 
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The specific goals of the Program are: 

1. To support significant, small-scale educational 
research projects. 

2. To facilitate participation in educational re- 
search by a broad range of college and univer- 
sity personnel. 

3. To encoiurage small colleges to undertake re- 
search programs so that students may benefit 
from having professors who are engaged in 
educational research activities, 

II., To provide for direct and expeditious' handling 
of proposals,^ 

As one Director of Educational Research phrased it, the RRP is 
committed to "building research resources." Regionalization itself 
is intended to simplify application procedures, and to make it easier 
for the promising researcher to compete for funds. As the regional 
office facilities become kno'wn in each locale, it is hoped that in- 
creasing n'umbers of researchers vnll seek the Program's support. 

Generally, the Program' s goals are not directed to resource bald- 
ing exclusively, but include dissemination and utilization of the 
resM'lts of research# In fact, dissemination is so important that USOE 
coitffjiles abstracts, published monthly in RIE (Research in Education), 
to provide an overvie'vj' of research on education throughout the nation# 
The individual researcher can augment this type of dissemination by 
utilizing his research to (l) improve classroom teachings (2) to 
stimulate thinking about educational problems among his colleagues, 
either through personal contact on campus or through professional meet- 
ings or publications; and (3) to develop interest in research on edu- 
cation among students# These are secondary outcomes the Directors of 
Educational Research anticipate from funded projects# 



Objectives and Procedures of This Study 

This study of the RRP has three objectives, all related to the 
effects of the RRP, In particular, we have f=ought to examine the 
Program 'id.th respect to: (l) the distribution of applicants for 

small grants; (2) the consequences of being fanded; and (3) the 
processing of proposals. 



p 

^Regional Project Research Guidelines for Preparing a Proposal , 
Bureau of Research, , Regional Research Program of the Office of Education, 
U.S, Department of Health, Education, and Welfare (March, 1969), p. 1, 
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To accomplish the objectives, the follovang data have been col- 
lected: 

1. Questionnaires from applicants, one version from 
funded applicants and another from those not 
funded 

2. Factual material from the proposals submitted by- 
applicants 

3. Questioniiaires from field readers who reviewed 
the proposals in the sample 

ii. ■ Field reader ratings of proposals and funding 
recommendations 

Interviews with the Directors of Educational Re- 
search at the nine regional offices. 

In consul -tation with the Directors of the Program, it was de- 
cided to collect data from the July 1, x96? through June 30, 1968 
(Fiscal 1968 ) period in which all nine regional offices were opera- 
tional, This is also the latest period that could be considered if 
applicants were to have an opportunity to complete projects prior to 
responding to the questionnaire. Although concentrating on Fiscal 
1968 sacrifices the opportunity to describe recent applicants, it 
seems preferable to examine the effects of the research than to sur- 
vey applicants whose research is still in the planning or data-col- 
lection stage. The sample includes every applicant submitting a 
proposal in Fiscal 1968. 

The information obtained from these applicants about their edu- 
cational backgrounds, positions, and institutional, affiliations pro- 
vides valuable baseline data. These data make it possible to compare 
applicants in later years -with applicants in this study. Such cumu- 
lative data -will enable policy makers to evaluate the Program .and plan 
its development, taking into account statistical evidence about the 
researchers attracted by the Program. 



Plan of the Report 

The report is organized according to the life-history of a re- 
search project — from submission of the research plan through dissemi- 
mtion of the findings. Chapter One, by describing the characteris- 
tics of applicants, answers the question: ]fIho applies to the 

Program? Chapter Two focuses on the funded applicant and shows to 
what extent the Program succeeds in supporting the less e:jg)erienced 
researcher who has developed a small-scale project having educational 
significance. 
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Chapter Tliree introduces the proposal section. It reviews the pro- 
posal itself^ talcing into account the subject matter, research design, 
modes of analysis, and budget. Chapter Four reports how the applicant 
learns of the Program, the resources he has available and those he uses 
while vjriting his proposal. The cost of preparing the document is also 
examined. Chapter Five deals with processing the proposal and considers 
the procedures for submission from three points of view; that of appli- 
cants, field readers, and the Directors of Educational Research. 

The outcomes of RRP-supported research are the topic of Chapter Six. 
Here the impact of the researcher’s work on classroom teaching, colleague 
exchanges, and students i? presented. Chapter Seven completes the 
analysis by providing an appraisal of the Program based on the opinions 
of applicants, field readers, and the Directors of Educational Research, 
It considers the process of review, the ceiling on grants, and the image 
of the Program. 

Chapter Eight presents conclusions and recommendations of this 
study of small -pro ject educational research under the RRP.' 

The report contains four supplementary sections: (l) a srmimary of 

the report; (2) a comparison of respondents and non -respondents to the 
applicant quest: onnaire and to the field reader questionnaire; (3) tables 
not included in the body of the report; and (I4.) the questionnaires and 
the codebook containing the frequency distribution of responses to each 
item of information. 



18 







CHAPTER ONE 



THE APPLICANT AND HIS INSTITUTION 



Every proposal submitted to the USOE Regional Research l^ogram (REP) 
is unsolicited. For this reason alone, it is of interest to know who 
chooses to apply. Moreover, the eligibility requirements are few. First, 
a prospective applicant must have the sponsorship of an institution or 
organization within the United States or- its outlying territories. 

Second, he cannot be conducting another project funded by the Program; 
and third, he must have fulfilled the terms of anj» prior grant or contract 
he may have received from the U.S. Office of Education. More positively, 
the Program seeks to attract the individual interested in uridertaking a 
small-scale project of some educational significance for which he has 
developed a suitable research design and procedvires. 

This chapter describes the background of those who apply and, in 
effect, answers the question; Who does the Program reach? We have 
considerable data from the 665 applicants with tdiich to build a statis- 
tical profile of those X'Aio apply. In particular, we will consider the 
institutional sponsorship of the applicant's proposal, his employment 
sta.tus, field of interest, professional activities, academic training, 
and familj'" background. 



Cooperating Institution 

Every applicant^ to the RRP as noted above, must have the sponsorship 
of an institution or organization such as a college, university, school 
system, or private fiim,^ This sponsor is listed on the title page of the 
proposal as the cooperating institution. Table 1,1 shows that the great 
majority of proposals submitted to the RRP — 8I|, per C6nt--naro8 a college or 
university as the cooperating institution. 

The fact thab mnst applicants list a college or university as the co- 
operating institution suggests thab institutions of higher education have the 
resc.:'^ces and facilities necessary for small -project research. They train 
professionals for teaching and research and have at hand classroom, labora- 
tory, and library facilities essential for pursuing research. 

One might expect that propo'^als submitted to the RRP vroifLd origi- 
nate in Schools of Education, In actuality over one-half ccme from 



iThe Applicant is defined as the person who intends to ccr.duct the 
research and devote a considerable proportion of his time to it. Typi- 
cally, the applicant is the project director named on the proposal r 

-Since this study was conducted, the regulations have been changed 
so that projects of individuals not associated with an institution can 
be funded. 
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TABLE 1.1 



A COLLEGE OR UNIVERSITY IS THE COOFERATIi'IG INSTITUTION 
FOR FIVE OUT OF SIX PROPOSAIS 



Cooperating Institution 


Proportion 
of proposals 
submitted 


College or tuiiversity 


.81t 


School system 


0 

H 

• 


Private agency (e,g,, a rehabilitation 
agency) 


•oU 


State department of education 


•01 


Other (e,g,, individual firm, educa- 
tional association) 


,01 


TOTAL 


1.00 (665) 



other departments (Table 1.2), More often than not, this is a liberal 
arts department such as psychology, but proposals can and do come from 
such diverse subdix'isions as a Department of Physical Education, a 
College of Medicine, or a School of Engineering, 

Both students and non-students are eligible for support from the 
RRP, In fact, three out of every ten applicants are students working 
either part-time or full-time toward an advanced degree (Table 1,3) • 



Employment Status 



Of student applicants, the highest proportion are studying for 
a Ph.D, rather than an Ed.D, degree. To be specific. Table l.E shows 
that 60 per cent of the student applicants seek a Ph.D, degree j 3^ per 
cent, an Ed.D.j and I4. per cent, a master's degree in education or a 
discipline. 

Later in this chapter when we discuss applicants who have already 
earned doctorates, we vrill contrast those holding a doctorate in one 
of the disciplines ijith those holding a doctorate in education. Here 
we only direct attention to the fact that mere student applicants are 
enrolled in Ph,D« programs, 3 




%Te know for some student applicants (113 of the 201 ) the kind of 
doctorate they earned in 1968 or expected to earn by 1969* Fifty 
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TA.BLE 1.2 



MORE THAN OME HALF OF COLLEGE OR UNIVERSITY 
SPONSORED PROPOSALS ORIGINATE OUTSIDE 
OF EDUCATION DEPARTMENTS 



Sponsoring Department 


Proportion 
of proposals 
submitted 


School or department of 
education 


.1|7 


Liberal arts department 


.31 


Professional school or 
administrative office 


.1^ 


Research bioreau 


.07 


TOTAL 


1.00 (560) 


NA = 


1 


Cases exclude 


lOit 




665 


%ot from an institution 
education. 


of higher 


TABLE 1.3 




THREE OUT OF TEN APPLICANTS ARE STUDENTS 


Eji^Dloyment Status 


Proportion 
of applicants 


Employed only 


.69 


Both employed and a student 


.20 


Student only 


.10 


Other status (e»g., post-doctoral 
fellow, emeritus professor) 


.01 


TOTAL 


1.00 (665) 



TABLE l.U 



SIX OUT OF TEN STUDENTS ARE 
STUDYBIG FOR A PH.D. 



Degree Sought 


Proportion of 
applicants 


Ph,D, 


,60 


Ed,D, 


.35 


Master' s 


.Oh 




TOTAL ,99 (201) 




Gases excluded’^ i;6i; 




665 



"'^Applicants not working towa.rd a degree. 



Moreover, not every doctoral or master's candidate who applies to 
the RRP intends his research for meeting academic requirements. Of 
the 201 student applicants, 1^9 said they intended their proposed 
research for a doctoral dissertation. At the time they submitted 
their proposals to the RRP, 1^6 were working to^iard a doctorate and 
only three were completing requirements for a master's degree, but 
these students were looking ahead to the tirae they would be using 
their RRP-supported research for a doctoral dissertation. It should 
be added that another 27 applicants are dissertation advisors i-jho 
anticipate that data from their proposed research will be used by 
one of their students for a dissertation,-^ 

A major problem confronting the nine Directors of Educational Re- 
search is determining an equitable -support level for doctoral candi- 
dates, if they shou].d be supported at all, Eadi has his cm point of 
view and, at present, they diverge considerably. One, for example, 
wants doctoral students to use the Program, but he advocates consulta- 
tion T'dth USOE during the planning stage of the dissertation so that 
the student incorporates USOE standards in the prospectus, as well as 
those of the department. Prom his experience too many students want 
to "tap the Program for funds" after the department has approved the 
project. 



per cent of these indicated their degree wovld be a Ph.D, in educa- 
tionj 37 per cent specified an Ed,D.j and 13 par cent, a Ph,D, in a 
discipline. See Appendix: B, Table 1,1, 

^Appendix B, Table 1,2 
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Ttvo Directors of Educational Research take the opposite view and 
recommend discontinuing support of dissertations. They feel that fel- 
loX'Tships are available elsewhere j doctoral students come from univer- 
sities which have a long-standing tradition of research. They prefer 
utilising the limited funds of the Program for building research re- 
sources at institutions where they are now meager. Others suggest 
that because the doctoral candidate’s paramount interest is obtaining 
his degree, he should be funded at a lower rate than a faculty member 
Tfihose research is expected to be disseminated in the classroom. These 
men agree that the Program should give students only "seed" money for 
facilities and a modest stipend rather than funding them at parity 
irith more e:?q:eri( need researchers. 

The analysis of the effects of the research conducted by doctoral 
candidates, a major interest of this study,^ hopefully will aid the 
Program’s directors in resolving the dilemma of the place of the doc- 
toral candidate in the Program, Of equal interest in assessing the 
impact of the RRP is the employment status of applicants, beyond the 
point of being students. Recall that Table 1,3 showed that nine out 
of ten applicants are employed at least part-tirae. The next table 
(Table 1,^) reports the position of employed applicants at the time 
proposals xvere submitted. 



TABLE 1,5 

Tl'JO-THIRDS OF THE EMPLOYED APPLICANTS ARE FACULTY 
I®1BERS AT A COLLEGE OR UNIVERSITY 






Position 


Proportion of 
applicants 


Faculty member 


•66 


Research director 


.07 


Administrative officer 


.07 


Teacher 


,C6 


Program director 


,o5 


Counselor or consultant 


,0U 


Student assistant or fellow 


•Oli 


School administrator 


,01 


TOTAL 


1.00 (596) 


NA = 


2 


Cases excluded* 


67 




665 


^Applicants not emplcyed. 



See Chapter Six, 
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Without a doubt, faculty members are the individuals most likely 
to apply to the RRP. . Of the applicants, only a fev; are research direc 
tors, administrators, school teachers, or other specialists in educa- 
tion. 



These same data enable us to examine the extent to v;hich the Pro- 
gram is meeting one of the stated aims, namely; 

To encouvage • . • research ... so that students may benefit 
from having professors who are engaged in educational 
research activities.^ 



The number of applicants among the 392 college or university faculties 
can be seen in Table 1.6. 



TABLE 1.6 

ALL FACULTY RAMS ARE REPRESENTED 
AMONG APPLICANTS 



Fhculty rank 


Proportion of 
applicants 


Assistant professor 


.36 


Associate professor 


.29 


Pull professor 


.26 


ether (e.g., adjunct, lecturer) 


•07 


TCTAL 


1.00 (392) 


NA = 


2 


Cases excluded''^ 


271 




665 



"^Applicants \-ihose principal position is not 
that of a faculty member. 



Clearly, applicants come from every professorial rank. And, in light 
of the Program’s interest in attracting young researchers to educa- 
tional research, it is encouraging to note that the highest proportion 
of these applicants are assistant professors. As one Director of Edu- 
cational Research put it, "The USOE small grants program seeks to give 
a chance to the ’little guy’ who might otherid.se lose out to the 
pros." 
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Ma.jor Field 



Not unexpectedly, the majority of applicants state that their 
major field is education (Table 1»7)» 

‘ TABLE 1.7 

A MAJORITY OF THE APPLICAI'ITS SPECIALIZE 
ra THE FIELD OF EDUCATION 



Major field 



Proportion of 
applicants 



Education 



Teacher training 


.39 


Administration 


.22 


Curriculxun 


• 1? 


Research and statistics 


.09 


Special education 
(e.g., adult. 


business) 


.08 


All other subareas in 


education 


.07 












1.00 (361) 






Psychology 


.21 


Social science (e.g., sociology. 


economics) 


.11 


Mathematics, physical or 


biological sciences 


.05 


English and language arts 


.05 


Other (e.g., music, medicine) 


.03 


TOTAL 


.99 (665) 



Vfithin education, those specializing in teacher training or in adminis- 
tration have the highest,- representation among the applicants. One- 
fifth of the applicants are in psychology, and most of these research- 
ers piirsue one of three sub-^ecialties, all of which have an educa- 
tional focus: developmental, guidance and counseling, or learning. In 

sum, 7^ per cent of the applicants are in one of these tx'jo major 
fields. 
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Higrhest Degree 



Although the largest proportion of applicants specializes in edu- 
catioi, this does not mean that a doctorate in education is the preva- 
lent degree. In fact. Table 1.8 shows that among applicants more have 
a Ph.D. in a discipline than either an Ed.D. or a Ph.D. in education. 
This table also shoxvs that I4.O per cent of the applicants have no more 
than a master's degree, and I4. per cent have only a bachelor's degree. 
Thus, the RRP is attracting a group of applicants t’dth relatively 
heterogeneous academic training. Even though, as Table 1.7 showed, 
the majority (^i; per cent) of proposals are submitted by applicants 
specializing in the field of education, the near equal number 
(li? per cent) from persons in the disciplines is fairly strong 
evidence that the problems of research are being attacked by a. broad 
range of perspectives. 



TABLE 1.8 

MORE APPLICANTS HAVE EARNED A PH.D. IN A 
DISCIPLINE THAInI EITHER AN ED.D. OR 
A PH.D. m EDUCATION 



Degree specialty 


Highest degree 


Proportion of 
applicants 


Discipline 


Ph.D. 


• 2 l| 


Education 


Ed.D. 


.17 


Education 


Ph.D. 


.13 


Discipline 


M.A. or M.S. 


.18 


Education 


M.Ed., M.A. or M.S. 


.22 


Discipline 


B.A. or B.S. 


.02 


Education 


B.A. or B.S. 


.02 




Other degree or pro- 
fessional diploma 


.02 




TOTAL 


1.00 ( 660 ) 




NA = 








66 ;? 



26 




<r % 

(^4 






It should also be noted, as Table 1,9 sho\iJs, that two out of 
every three degrees liave been avjarded since I960— a finding vrhich only 
confirms the fact that, .the Program is reaching young researchers at 
the beginning of their careers. Of even more interest, is the finding 
in Table 1,9 that li3 per cent of these applicants liave earned their 
doctorate vjithin the last four years. 



TABLE 1,9 

TVJO OUT OF THREE DOCTORATES 
HAVE BEEN EARNED SBICE I960 



Year of 
degree 




Proportion of 
doctorates 


Before I960 




.33 


i 960 - 1963 




• 2h 


196ii - 1967 




•h3 




TOTAL 


1.00 (3U7) 




Cases excluded’'^ 


309 




NA = 


9 






66? 



*Other degree or professional diploma. 



We complete this brief description of the applicants studied by 
reporting a few statistics about their personal and family back- 
grounds,? All but nineteen applicants are t^itej more than foui out 
of five are married men Td.th either txro cr three dependents, I^pi- 
cally, they are 3.S years old with a median income of 3plh,000 in 1968 
which they expect to reach $l6,000 in 1969, Two out of three have 
parents who did not attend college nor did one-third of these even 
complete grade school. 



Summary 

In sum, the Program is attracting men xdio are on the faculty of 
an institution of higher education. They are more likely to be junior 
than senior faculty members, and mors likely to have earned a Ph,D, 

7 

See Appendix B, Tables 1,3**1,10 for the s t at isticsi summarized 

here. 
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±n a discipline tlian either an Ed.D. or a Ph«D« in education. Finally, 
the Program has succeeded in reaching young researchers x^hose primary 
interest is education, be it degree specialty or cxrrrent major field. 
These individuals comprise the majority of the applicants. 




CHAPTER Tl-ro 



THE SUCCESSFUL APPLICANT 

The USOE Regional Research Program (RRP) is based on the princi- 
ple that individuals with good ideas who are interested in undertaking 
a small-scale project in educational research will find the Program 
receptive. The applicant need not be affiliated with a prestigious 
institution or have a long list of publications to his credit. He 
must only have researchable ideas TO.th educational significance and be 
capable of carrying his project to completion. 

To anticipate the results of this chapter, to a surprising degree 
the RRP is a place where the unknown educational researcher can market 
his idea. Whatever faults the Program may have, the Directors of Edu- 
cational Research in the nine USOE I'-egions have succeeded in implement- 
ing this Program goal. In fact, this goal may be the strongest feature of 
the Program, 

To our knowledge, until this study of the RRP was undertaken, no 
systematic information about the fuj.iding patterns of granting agencies 
existed,^ To be sure, foundations and government agencies package 
attractive annual reports describing their many grant programs. They 
do not, however, report how many applicants applied for support or 
what characteristics differentiate the successful from the unsuccessful 
applicants. 

For this reason alone, this study of the RRP should be of interest 
to the research community. It provides considerable information about 
the process of sorting applicants into those who are funded and those 
who are not. 



Cooperating Institution 

This chapter focuses on the individual and institutional charac- 
teristics that identify the funded applicant. Of the 665 applicants, 
we look first at the institutional characteristics of the 25l who were 



^Two descriptive articles have been published on why research 
proposals are disapproved: Ernest M, Allen, “Why Are Research Grant 

Applicants Disapproved?" Vol, 132, Science (I96O), and 

Gerald R, Smith, "A Critique of Proposals Submitted to the Cooperative 
Research Program," in J, Culbertson and S, Hencley (eds,). Educational 
Research; New' Perspectives (Danville, Illinois: Interstate Printers 

and Publishers, I963), Ch, 17, 277-287 • 



funded, (In proportions this comes to 0,38 of the applicants,) More- 
over, the funding pattern reflects whether the sponsor is an institu- 
tion of higher education or one of a variety of institutions or organi- 
zations not in higher education such as an elementary or secondary 
school system, a state department of education, or a private firm. As 
Table 2,1 shows, the applicant whose cooperating institution is a 
college or miversity clearly is most likely to be funded. 

TABLE 2,1 

COLLEGES OR UNIVERSITIES SPONSOR THE HIGHEST 
PROPORTION OF PlTi®ED APPLICANTS 



Cooperating Institution 


Proportion 
of applicants 
funded 


Nxomber of 
applicants 


College or unix'ersity 


.ho 


(^60) 


School system 


.27 


( 66 ) 


Private agency (e.g,, a rehabilita- 
tion agency) 


.29 


(2h) 


State department of education 


[hi 


(9) 


Other (e.g,, private firm, educa- 
tional association) 


[ 0 ] 


( 6 ) 


TOTAL 


.38 


( 66 ?) 



Note ; Bracketed numbers refer to the actual number of funded 
applicants where there are too few cases for determining proportions. 



The finding that proposals submitted by school systems were least 
likely to be funded (only 27 per cent) xra.s suggested to us before the 
results of the applicant survey x^ere tabulated. Dxiring our interviews 
x-rith the Directors of Educational Research, more than one pointed out 
that the personnel of school systems lack expertise in proposal writ- 
ing and need individualized assistance to prepare a satisfactory pro- 
posal. As one phrased the problem, 

I*d like to liave more time to go out there [to school systems], 
sit dox-jn x^rith the research director and his staff and help him, 

I know they are capable of xjriting a proposal that could be 
funded. 

To this Director of Educational Research, the school system diould be 
a more important target of the Program because so many graduates of 
Schools of Education go into the public school system and as staff 
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members, plan curricultun development in a setting where the research 
skills for evaluating the innovation are often lacking. 

The Directors in two other regions remarked that they assign a 
lower priority to working with school system personnel than in.th col" 
lege or university adiTiinistrators and faculty x7ho are just beginning 
to develop a research orientation. They reason that more federal 
money is channeled into elementaiy and secondary education for evalua- 
tion research than into developing institutions of higher education. 

Another Director of Educational Research takes a different posi- 
tion, He thinks that for the present it is unrealistic to e:J 5 )ect 
school districts to contribute to research in a major way, at least in 
his region. 

Only the very, largest school systems can afford any kind of 
research staff. School districts tell me point blank that they 
just don’t have any x-esources for doing research. State legis- 
lation straps them in funds. 

In this Director’s view, school districts should be utilizers of re- 
search and identifiers of problems tha.t need solution, but not re- 
searchers, per 

Finally, txra others indicated that they do not have specific tar- 
get populations in their regions. One said: 

I go out after the idea, irrespective of where it comes from. 

The other remarked: 

I’m out to identify the potentially good researcher anywhere, 

I can' t be expected to give him training in depth, but I can 
be expected to open research opportunities to him. 

Thus, there is a diversity of opinion among the Directors of Edu- 
cational Research about encouraging the personnel of school systems to 
submit p:'’oposals to the RRP. At the same time, the structure of many 
school systems, as xjell as their internal requirements, probably limit 
the extent of their participation in a program such as the RRP. The 
topic of school systems and the RRP, of course, merits a study of its 
oxm. Here ve only call attention to the fact that for whatever 
reasons— unofficial policy, preferences of the Directors, or obstacles 
vri.thin school systems— the fact is clear: school systems do not fare 

as x-jell as colleges and universities in securing funds from the RRP. 




Sponsoring Department 



JVom Chapter One we learned that proposals sponsored by a college 
or university originate most frequently in Schools or Departments of 
Education, We also know, of covirse, that these proposals are submitted 
to conduct research on education. With this information, one might 
guess that proposals listing a School or Department of Education as the 
university subdivision would be most likely to be funded. Such is not 
the case, however, as Table 2,2 shows. 



TABLE 2.2 

APPLICANTS SPONSOPJCD BY UNIVERSITY RESEARCH 
BUREAUS ARE MOST LIKELY TO BE FUNDED 



Sponsoring Department 


Proportion 
of applicants 
funded 


Number of 
applicants 


Research b'ureau 




(38) 


Liberal arts department 


O 

m 


(176) 


Professional school or 
administrative office 


.39 


( 82 ) 


School or department of 
education 


.38 


(26it) 


TOTAL 


,U0 


(560) 


Cases excluded'^ 




io5 






(665) 



%ot at an institution of higher educa.tion. 



As may be seen in Table 2,2, research bureaus submit the fewest propo- 
sals to the RRP, but it is the applicants sponsored by research bureaus 
who have tl .3 best chance of getting funded. 

Perhaps the most important finding in Table 2,2, however, is that 
the greatest nmber of applicants for RRP funds are associated with a 
School or Department of Education, but these applicants are, if any- 
thing, slightly less likely to be funded than the smaller number from 
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a liberal ax'ts departnent or from a professional school 4 Except for 
applicants from a research bureau, the difference in funding rate among 
university subdivisions is so small that it 'warrants eaqslanation 4 



Highest Earned Degree 

Knowing that the Ph.D, is usually perceived as a research degree 
and the Ed.D. as oriented toward professional practice, the next step 
in finding out which applicants are more successful is to explore 
their academic backgro'unds4 Because so many applicants had not earned 
a doctorate when they applied for a grant from the RRP, Table 243 re- 
ports the proportion of applicants fvmded by whether their highest 
degree in 196?^ 'was a bachelor’s, master’s or doctorate4 

The figures in Table 2,3 are quite revealing. They show that ap- 
plicants trained in a discipline, whether holding a doctorate or only 
a master's degree, are most likely to be funded. To be specific, a 
total of I4.3 per cent idao have - doctor’s or a master's degree in a 
field other than education submit successful proposals, but only 3U 
per cent of uhose xvith a Ph.D, in education and 30 per cent with a 
master's in education are funded* 

To a leading spokesman for educational research. 

Solid training in one or more of the behavioral, social 
and humanistic disciplines is indispensable for thought- 
ful educational research,^ 

Judging by the funding pattern of the RRP, today's talented researcher 
is recruited to the field of educational research rather than being 
trained as a researcher while a graduate student specializing in educa^- 
tion. 



Of particxfLar significance is the ability of the RRP to attract 
young researchers to educational research, that is, those who have no 
more than a master' s degree in another field. One can ass'ume that 
these individuals are in an institutional setting 'that provides con- 
tact bet'ween the field of education and their O'wn discipline or they 
■would not have thought of applying to 'bhe RRP for a small -projects 
grant, Fxirther analysis of our data -will show how many of these II6 
applicants intend their proposed research for a doctoral disser'fcation 
and the e^ent to vrhich they are committed to the field of educational 
research,^ 



^1967 is used because this study focuses on applicants who sub- 
mitted proposals to the RRP between July, 196? and June, 1968, 

^Lee J, Cronbach, "The Role of the University in Impro'ving Educa- 
tion," Phi Delta Kappan , ?ol, k7 (June, 1966), 

^See Chapter Six, 
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'TABLE'?, 3 

APPLICANTS VJITH THE DOCTORATE OR A MSTER'S DEGREE 
IN A DISCIPLINE ARE MOST LIKELY TO BE FUNDED 



Degree specialty 


Highest' degree 


Proportion 
of applicants 
funded 


Number of 
applicants 


Discipline 


Ph.D. 


»Ii3 


(161) 




liaster ' s 


• k3 


(116) 


Education 


Ed.D. 


•ho 


(112) 




Ph.D. 


•3k 


( 83 ) 




Master ' s 


.30 


(III?) 




TOTAL 


.38 


(619) 




Cases excluded'' 




lA 




NA = 




5 








665 



“Other degree or professional diploma. 



One ciirious finding in Table 2.3 deserves comment; namely, appli- 
cants with a Ph.D. in education are somewhat less likely to be funded 
than those \cith an Ed.D. ( 3 I 4 . per cent of the Ph.D.'s in education and 
UO per cent of the Ed.D.'s). We expected just the opposite because 
Ed.D. graduate programs provide training for teaching and professional 
service while the Ph.D. g^duate programs in education are oriented 
toward research training.^ Table 2.11. in the next section of this 
chapter will help explain this finding by showing that only certain 
Ph.D.'s in education are less likely than Ed.D.'s to be funded. 



^See Buswell and McConnell study of 19 and 196k Ed.D.'s and 
Ph.D.'s in education for an analysis of the differential training and 
career activities of these tvro groups of educational specialists. Guy 
T. Buswell and T.R. McConnell, Training for Educational Research , Co- 
operative Research Pi’oject No. 3107ij. (Berkeley, California; Center 
for the Study of Higher Education, University of California, 1966). 



Previous Research Grants 



Research costs money and even the most modest inquiry requires a 
researcher's time and available supplies. Moreover,- most educational 
research is not an operation that can be undertaken by one individual 
equipped ^^rith no more than a typewiter, a ream of paper, and the 
kitchen table. Under these circvimstances, it is only natural that re- 
searchers seek funds to carry out their work. 

We purposely asked applicants seeking funds from the RRP whether 
they had obtained research grants in the past. The question was 
worded: 

[Prior to applying for a grant from the RRP] have you 
ever received a research grant from any of the follow- 
ing sources? 

Sources ranged from a government agency to the applicant's own insti- 
tution. Of the researchers funded by the RRP, 43 per cent had never 
received a previous research grant® — evidence that the RRP does give 
the yo’ang researcher a chance to get started. 

Does the RRP, however, fund the less experienced researcher re- 
gardless of his level of training? In other words, is the Program 
Ciqually likely to support pre- and post-doctoral applicants? Then too, 
how does the area of specialization infltience the applicant's chances 
of obtaining support? We know that applicants trained in a discipline 
are more likely to receive RRP support than those trained in education, 
but is this still the case when we relate degree specialty and research 
grant experience to funding? 

Table 2.U answers these questions and adds to our knowledge of who 
is funded. First, there are differences among those who have previ- 
ously received a grant and those who have not. In four out of five 
comparisons, those who have not received a previous grant are more 
likely to be funded by the RRP than those who have. This finding is 
shown in the column headed "Difference." 



Appendix B, Table 



2.1 



TABLE 2.1; 



;\FPLICANTS VJHO HAVE NEVER RECEIVED A RESEARCH 
GRANT ARE MORE LIKELY TO BE FUNDED 



Degree 

specialty 


Highest 

degree 


Previous grants 


Difference 


None 1 One or more 

(Proportion funded) 


Discipline 


Ph.D. 


.^2 


(23) 


.I;0 


(136) 


+ .12 




Master’s 


•^h 


(6^) 


.29 


(5l) 


+ .25 


Education 


Ph.D. 


• h7 


(1^) 


.30 


(66) 


+ .17 




Ed.D. 


.36 


(25) 


• k2 


(86) 


-.06 




Master’ s 


.36 


(88) 


.21 


(56) 


+ .l5 




TOTAL 




(2l6) 


.3^ 


(395) 





N = 6ll 



Cases excluded"'^ i|l 

NA = 13 

66 ^ 






Other degree or professional diploma. 



Second, Table B.I; shows that more than one half the applicants 
who have a degree in a discipline obtain their first research grant 
from the RRP. To be specific, ^2 per cent of the applicants with a 
Ph.D, in a discipline (row l), and per cent of those with a master’s 

degree in a discipline submit research proposals that are funded. This 
is an important finding. The Program supports not only vinknown re~ 
searchers, but it also gives as much chance to the pre- as to the pest- 
doctoral applicant from a di.scipline. 

Third, Table 2, 1; provides more information about the Ph.D, in edu- 
cation that helps differentiate him from the Ed.D, It is the Ph.D. in 
education vdth no other research grant to his credit >ho is more likely 
to be a successful RRP applicant than the Ed.D, in the same circum- 
stances. Note, however, that recipients of the research degree in edu- 
cation who have been amrded other grants do not fare so well as RRP 
applicants — only 30 per cent are funded. 
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Finally, the funding pattern for the Ed.D,, as shoi'jn in Table 2,1|, 
is perplexing. Of all the applicants, they are the only group More 
likely to be funded if they have received a previous grant. The ex- 
planation, as we t'dl.l see shortly, lies in the present field of 
interest of these applicants. 

Earlier, Table 2,2 showed tliat about the saw» proportion ox appli- 
cants from Schools of Education and from liberal arts departments are 
funded by the RRP, VJhich applicants in these subdivisions is yet to 
be e:q)lored, Knotring that type of degree distinguishes the funded ap- 
plicant from the not funded one, we want to consider this characteris- 
tic jointly idLth departmental affiliation to further delineate the 
recipient of RRP fmds. Table 2,^ shox-rs this relationship. 

First, we i-?ant to mention that the nimbers appearing in some of 
the cells under the headings "Research bureau," "Other subdivision," 
and "Not in higher education" (the last three columns of Table 2,^) are 
too small to shox-r a clear pattern. We simply present these data to 
assure the reader that these applicants have not been overlooked. 

The key finding in Table 2,5 is that applicants trained in a dis- 
cipline xjho subsequently cross over to Schools or departments of Edu- 
cation are particularly likely to have subnitted successful proposals. 
This is the case for applicants xdio have either a Ph,D, or a master’s 
degree and especially so for those x\dth only a master’s degree. By 
reading the second rox-r of Table 2,5, xje see that I|.6 ]j)er cent of the 
applicants affiliated xm.th Schools or departments of Education in addi- 
tion to holding a master’s degree in a discipline are funded, xdiereas 
only 38 per cent of those xjith the same type of degree but in liberal 
arts departments are successfxiL, 

Conversel 3 /', the few applicants xd-th a Ph.D, in education x 7 ho move 
into liberal arts departments are more likely to be fun do d than their 
more numerous peers xd.th an identical degree xjho have remained in 
Schi ols or departments of Education, 

Prom the figures in Table 2,5 one cannot draw the conclusion that 
researchers trained in one area xjho then become affiliated with another 
are necessarily better researchers. But the data do suggest that these 
men are in departments free of traditional barriers or they XTOuldn’t 
have been recruited in the first place. For instance, the applicant 
x-rith a Ph.'D, in a discipline attached to a School of Education is a 
prime example of hox>r some Schools of Education develop communication 
xrith relevant disciplines. PWther research XTOxfLd be needed to learn 
xv^hether, in general, investigators trained in one field who are re- 
cruited to another offer promise as researchers, Hoxirever, xre can say 
that among the applicants, those trained in a discipline x/ho are 
attracted to Schools of Education merit study as a raanpox/er resource 
for developing educational research. 



TABLE 2.^ 
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o» 

rH 




|1A 

vO 


MD 


1 


VO 



rS 

TJ 

CD 

CO 

CD 

CO 



c\5 

O 
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■^Other degree or professional diploma. 

Note: Bracketed numbers refer to the acti:ial number of f\mded applicants 

xdiere there are too few cases for determining proportions. 



Most Ed.D.’s, as one tjould expect, are affiliated xd-th Schools or 
departments of Education. Moreover, as applicants for RRP funds they 
£.re more successful than their colleagues ijith Ph.D.'s in education who 
tiave the same type of affiliation. Forty-three per cent of the Ed.D.'s 
in contrast to 33 psr cent of the Ph.D.'s x-Jho specialize in education 
are funded* Why Ed.D.’s are more likely to be successful leads 
directly into the next, and last, section of this chapter which focuses 
on the applicant’ s field of interest at the time he submitted his pro- 
posal. 

Major RLeld 

Every applicant xdio completed our questionnaire vjas asted to 
designate Ixis major field or specialty at the time he submitted his 
proposal to the ]®P Not unexpectedly (as shown in Table 1.7) a 
majority of applicants designated education. , The second most fre- 
quently listed specialty x-ias psychology. Together these two fields in- 
cluded 7^ per cent of the applicants. The remaining 2^ per cent >rere 
in a variety of fields ranging from aid; to zoology* 

The fact that applicants more often than not are in some branch 
of education does not necessarily mean that they are the caaes who are 
funded. On the contrary, psychologists are most likely to submit 
mnning proposals, as may be seen in Table 2*6. 



TABLE 2.6 

PSYCHOLOGISTS ARE MORE LIKELY TO BE RJNDED 
THAW SPECIALISTS BJ ANY OTHER HELD 



Major field 


Proportion 
of applicants 
funded 


Number of 
applicants 


Psychology 




(i1j3) 


Education 


.3^ 


(361) 


Social science (e^/g., 
sociology, 
economics) 


.35 


(7U) 


All other .fields 


.38 


(87) 


TOTAL 


.38 


(66?) 




Applicants in education specified the sub-area of interest xidthin 
their major field— for example, administration, teacher training, or 
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research and statistics. Applicants in psychology did likevri.se, naming 
developmental psychology, guidance and counseling, or another subspeci- 
alty* 



Now xre want to consider the funding patterns of the RRP taking 
into account the subspecialty of the many applicants in psychology or 
education. Doing so vjill further differentiate the applicants and, as 
vre vjill see shortly, explain a seemingly paradoxical finding shown in 
Tables 2,3 and 2,^: Ed.D.'s, the recipients of a doctorate oriented 

tovrard professional practice, are more likely to be funded than Ph.D.’s 
in education, the recipients of the research oriented degree. 

Within psychology, it is the applicant vrho speciializes in learning 
or developmental who is most likely to obtain RRP funds (Table 2,7 be- 
low) , Then, vri-thin the field of edvacation, the applicant X'J'ho i^eci- 
alizes in teacher training or administration is more likely i:o be 
funded. Parenthetically, we might add that more applicants come from 
these two subspecialties than any other, as can be seen from the 
figures entered in the last column of Table 2,7« 

An applicant’s degree and his ma.jcx- field of interest are, of 
course, closely related. One trained in education tends to work in 
that field, and one trained in a discipline tends to stay vri-thin his 
discipline. But the story is not so simple. ¥e know from Table 2,^ 
that applicants vrilth a Ph,D, in a discipline v:ho switch to a School of 
Education are especially likely to be f^ded for a s mall -projects 
grant, ¥e then began to consider vihether these Ph.D.’s name psychol- 
ogy or a branch of education as their major field of interest. 

Moreover, throughout this discussion of funding patterns we have 
found the Ph,D, in education an enigma, .In general, he is less likely 
to secure RRP funds than the Ed,D, The exception is the very few (11 
cases) xdio svTitch to liberal arts. These applicants have a high 
funding rate; all the others lag behind the Ed.D.’s, as shown in Table 
2 ,^. 



In an effort to explain vdiy almost all Ph.D.’s in education do 
poorly relative to Ed.D.’s in education as conpetitors for RRP funds, 
we decided to explore the field of interest of applicants with a 
doctorate. We have learned, for example, that applicants in some 
areas of education, notably teacher training and administration, are 
more likely to be funded than those in other educational sub-areas. 

We began to think we should find out who these applicants are— Ed.D.’s 
or Ph.D.’s in education, or perhaps even Ph.D.’s trained in a disci- 
pline. 

As it turns out, this exploration x^as revjarding. The results of 
jointly relating type of doctorate and sub-area of interest to the 
probability of being funded are presented in Table 2,8, Admittedly, 
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mBLE 2.7 



FTOIDING 1-JITHIN PSYCHOLOGY AND PHTHIN 
EDUCATION VAFtlES BY SUB-AREA 



Sub-area x-dthin 
psychology or education 


Proportion 
of applicants 
l\mded 


Number of 
applicants 




rsychoj.ogy 








Learning 


,^6 


(23) 




DevelqDmental 




(20) 




Educational 


,5o 


(lU) 




Guidance and counseling 


,1|0 


(1x8) 




Personality 


[y 


(9) 




Testing and measurement 


[3] 


(7) 




Clinical 


[3] 


(7) 




All other subspecialties 


.33 


(15) 




TOTAL 


cii5 




(ly) 


Education 








Teacher training 


,1|0 


(li|2) 

(78) 




Administration 


,I;0 




Research and statistics 


.32 


(3U) 




Curriculum 

Special education Ce.g., 


.27 


(55) 




adult, business) 


,25 


(28) 




All other subspecialties 


,25 


(2h) 




TOTAL 


.35 




(361) 






N = 


50ii 




Cases 


excluded'^*’ 


161 








665 



''Applicants in other fields. 



Note t Bracketed numbers refer to the actual number of funded 
applicants xdiere there are too fexf cases for determining propor- 
tions. 



TA.HLE 2.8 



PH.D.'S mU'IED IN EDUCATION ARE HOST LIKELY TO 
BE FUNDED T'JHEN THEIR FIELD IS PSYCHOLOGY 





Type of doctorate 


Major field 


Ph.D, in I Ph.D. in a 
education ' discipline 

(Proportion fundee 


Ed.D. 

i) 


Psychology 

Developmental, learning, 
testing and measurement 


C^] (6) 


.58 ( 31 ) 


[0l (3) 


Guidance and counseling, 
personality 


[ 3 ] (9) 


[2] (8) 


.U6 ( 13 ) 


Educational 


[2] (1;) 


[ 0 ] ( 1 ) 


[ 2 ] (3) 


Other (e.g., clinical, 
social) 


[1] (3) 


.38 ( 16 ) 


[1] ( 1 ) 


TOTAL 


.$0 (22) 


.U6 (56) 


.U5 ( 20 ) 


Education 

Teacher training 


.2h (29) 


.59 (17) 


N = 98 

.39 (36) 


Administration 


[0] (5) 


[0] (3) 


.U5 (22) 


Research and statistics 


[ 2 ] (8) 


[ 3 ] (5) 


.50 ( 10 ) 


Curriculum 


(11) 


[0] (1) 


.32 (19) 


TOTAL 


.26 (53) 


.50 (26) 


.ko ( 87 ) 



N = 163 
Cases excluded* I 4 .OI 1 

^ ^ 

'Applicants mth another degree or a professional diploma who ai’e 
now in the field of education or psychology (N = 2k3) and applicants 
in other fields (N = l 6 l). 

Note ; Bracketed numbers refer to the actxzal number of funded ap- 
plicants in a field i-dien there are too few cases for determining 
proportions. 



there are rel i lively few cases, but the findings are suggestive. 

Comparing the total number of discipline trained Ph.D.'s in the 
fi'-lu of education with the ones in psychology, we see that they are 
about equally likely to be successful. Fifty per cent of those 
Ph.D.'s now working in education are funded as are I4.0 per emt of 
those in psychology. Making the same comparison for Ed.D.'s, we see 
that whether they are interested in education or psychology, they are 
also about equally lil' ^ly to be funded — hO per cent in education, and 
per cent in psychology are successful. However, the percentages 
fox' the Ph.D.'s trained in education diverge considerably. Most are 
interested in education, but only 26 per cent of them are funded. By 
contrast, the few now in psychology have a good chance of being 
funded — exactly ^0 per cent. 

Studying the 3 ovrer part of Table 2.8, namely, the section headed 
"Education," vre can tx’ace in more detail the funding trend of appli- 
cants ;ri.th the three types of doctorates in the sub-areas xm.thin edu- 
cation. The prinoipal finding here is that in. the sub-area teacher 
training, the Ph.D, in education is no match for the Ed.D, or the 
PhoD. trained in a discipline. The Ph.D. from a discipline also 
kncxdedgeable in the area of teacher training gets funded xri.th rela- 
tive ease— per centj to be precise. The Ed.D, ranks second — 39 
per cent are fxinded. However, the Ph.D. in education xMio identifies 
himself as specializing in teacher training appears to be a loser— 
his fmeiing rate is only 2[x per cent. 

Me did not attempt to gather data on graduate e:xperiencej hence, 
ire cannot say if this contributes to the percentage differences xre 
see in Table 2.8 among funded applicants xirho specialize in teacher 
training. We will keep this finding in mind as x-ie proceed vjith the 
analysis, but xmfortxxnately, the questionnaire data do not provide a 
ready ansxrer. 

For the few applicants in the field of educational administra- 
tion, the figures point in the same direction as those discussed 
above. Forty- five per cent of the Ed.D.'s in educational administra- 
tion are fandedj but none of tlie P.h.D.'s— xdiether from a discipline 
or education. The field of educational auninistration has been pre- 
empted by the Fd.D.'s applying to the RRP, 

In brief, our data suggest that the applicant idth a Ph.D. in a 
discipline has the universal degree. He can switch to the field of 
education or remain in a discipline (typically, psychology) and sub- 
mit a proposal for eiucati-onctl research that has the best chance of 
being funded by the HRP. The Ed.D. is not as likelj' to be fxxnded as 
the Ph.D, from a discipline x-rhen both designate education as the 
major field. The fex/ Ed.D.'s who ci’oss c-.-er into psychology fare as 
vrell a.' their colleagues from the disciplines as recipients of RRP 
funds. The Ph.D, in education, hoxrever. has an uneven rate of success. 



Only those in psychology are likely to be funded. 



Summary 

Overail, this chapter lias shovjn that the RRP in.vests considerably 
in the less e:q3erienced researcher# a stated aim of the Program is to 
support promising researchers \-jho seek to undertake a small-scale 
project in educational research, and the data show that to a consider- 
able extent the Program succeeds in this aim# 

In particular, o\ir data indicate that the funded applicant can 
have a master’ s degree or a doctorate and be in almost any field, al- 
though his chances of being funded are ma.ximal if he is in psychology. 
Moreover, the funded applicant is usually a novice in obtaining 
research grants# For c.:ample, he is more likely never to have received 
a research grant than to have a grant or two to his credit# 



CHAPTER THREE 



THE PROPOSAL 



The caie means the applicant , has of communicating -with the review- 
ers who will evaluate his research plan is through the proposal. The 
Guidelines caution "... if it [the proposal] does not convey the mes- 
sage, staff and field readers will not assume meaning or intent. "1 As 
the contents of the proposals are examined, it will become apparent 
that all too often this caution has not been heeded. For the purpose 
of this discussion, the contents of the proposals are divided into six 
sections: 



1. Subject matter 

2. Educational level 

3. Group to be studied 
Research design 
Modes of analysis 

6. Budget 



Subject Matter 



An aim of the USOF Regional Research Program (RRP) is to st uim- 
late research on educatj.on, and vhe Program has elicited proposals 
for studies Which go far beyond the usual subjects of reading, writing, 
and arithmetic. Virtually every field is represented,^ even those 
with seemingly remote connections to education. The following ran- 
domly selected titles suggest the range and richness of subject matter; 



"Biomechanics of Wormal and Treadmill Running" 

"Photographic Study of Nonverbal Responses in Youth" 

"Discrimination of Recency in Children"; 

"Assaultive Language Usage Reveals Level of Self- 
Worth Among Ghetto Negro Teen-Agers in Group Situa- 
tions — An Exploratory Stucfy*' 

"Nonverbal Communication — ^Attituda Change and Hierar- 
chical Roles." 



^Guidelines, 



op. cit . , p# 3» 



^ee Appendix B, Table 3.1 for detailed classification of subject 
matter. 



As may be seen in Table 3«lj the distribution of subject matter falls 
into three main groups: psychology (30 per cent), education (27 per cent) 

and a conglomerate of less frequently chosen subjects (kh per cent). The 
two major clasGifications-~psychology and education — have been used here 
as a means of differentiating education as a psychological process of 
learning from education as an institution. 



TABLE 3.1 

THE SUBJECT MATTER OF HIOPOSALS 



Subject of proposed research 


Proportion of 
proposals 


Psychology (education as a process) 


.30 


Education (education as an institution) 


.27 


Mathematics, physical, or biological 
sciences 


.15 


English and language arts 


.13 


Social sciences other than psychology 


.10 


Music or art 


.06 


TOTAL 


1.01 (65l) 


Subject not elsewhere classified 
(e.g., aviation) 


11 


Not classifiable by subject 
(e.g., student activism) 


3 




665 



’’^Tables in this chapter compare the funded and the 
not funded proposal only v;hen uhe data show a difference 
between these two groups. 



Within each field, the subspecialty provides a r.c^e precise definition 
of the subject matter to be examined in the study. For example, within 
psychology it may be educational psychology, testing and measurement, 
counseling, or guidance and placement. Within education, the specific 
area may be administration, .finance, or history, or philosophy of education. 

Apart from the fact that the few proposals from the fields of 
music and art have a slightly higher funding rate tixan proposals from 
other fields, there is no apparent difference in the funding pattern by 
subject matter (Table 3.2), 
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TABLE 3.2 



A VARIETY OF SUBJECT MATTERS ARE FUNDED 



Subject of proposed research 


Proportion of 
proposals 
funded ■. 


Nuraber of 
proposals 


Music and art 


,I;6 


(37) 


Mathematics, physical or biological 
sciences 


,h0 


(97) 


Social sciences other than psychology 


,h0 


(66) 


Psychology 


.38 


(193) 


Education 


.36 


(173) 


English and language arts 


.3^ 


(8$) 


TOTAL 


.38 


(6$1) 


Subject not elsewhere classified 
(e,g,, aviation) 




11 


Not classifiable by subject 
(e,g., student activism) 




3 






Si 



'Tables in this chapter compare the funded and the not 
funded proposal only when the data show a difference betvreen 
these two groups. 



r-'oposals in psychology and in education, X'rfiich together total almost 
sixty per cent of all submissions, are equally likely to be funded. 

So too are the proposals in mathematics, English or one of the other 
social sciences. In sum, for proporals with these different subject 
matters, the difference between the minimum and maximum funding rate 
is only 5 per cent. 



Educational Level 



As Table 3,3 shows, the educational levels to be studied extend 
from pre-school to higher education. The studies concentrate on the 
elementary, and secondary schools, which. taken together axe mentioned as 
the level of interest in 56 per cent of the proposals. The post- 
secondary levels are the anticipated focus of attention in over one-half 
of the studies (5l per cent); but fcx this group of proposals, the foiir 
year college is the level most frequently included in the research plan 
(37 per cent). 



TABIE 3.3 

LEVEL OF EDUCATION TO BE STUDIED 



Educational level to be studied 



Pre-school 
Lower levels 



Elementary ,28] 

Secondary ,28] 

Higher levels 

College ,37. 

Junior college «06, 
Vocational ,05. 

Graduate ,03. 



Entire school system 



TOTAL 

Educational level 
not specified 

Not applicable 



Proportion of 
proposals 



.07 



,56 



,5i 



,01 

i,i5* (5 i7) 

59 

89 

665 



"^otal exceeds 1,00 because more than one 
educational level will be studied. 



Group to Be Studied 

Considering the fact that there is a $10,000 ceiling on HR? 
projects, it is not \mexpected that students lead the list of groups 
to be studied (Table 3»h-). 



TA^E 3.1; 



SEVEN OUT OF TEN PROPOSALS SPECIFY 
THAT STUDENTS VJILL BE STUDIED 



Group to be studied 


Proportion of 
proposals 


Students 


.69 


Teachers 


ak 


Schools 


.06 


Principals 


.03 


Community 


CM 

0 

• 


School district 


,01 


Parents 


.01 


Guidance counselors 


.01 


Other (e.g., employers, citizens, 
taxpayers ) 


.15 


TOTAL 


1.12'^ (5U3) 


Not applicable 


122 




665 



'^otal exceeds 1.00 because more than one group 
■will be studied. 



It is less ejq^ensive to administer, for example, standard tests to 
captive classes of students than to research other groups. 

As may be seen in Table 3.U, 69 per cent of RRP proposals focus 
on students. Researchers seldom simultaneously include ’teachers, as 
evidenced by the 55 point difference in the proportions. Of course, 
not all lU per cent of the teacher groups are paired -with students. 
Teachers themselves are studied separately. Other roles directly 
connected iiith the educative process are aDnost completely over- 
looked. The school as a -whole has a better chance (6 per cent) of 
being studied than principals (3 per cent), parents (l per cent) and 
guidance counselors (l per cent). 

Although the Guidelines state that applicants are "... to outline 
the proposed research procedures carefully,"3 our efforts to classify 

^ Guidelines , loc. cit . 



the contents of proposals reveal that many do not. Of the 377 appli- 
cants planning to study students, 3i; per cent fail to specify even a 
rough estimate of the sample size,^ Only 9 ©er cent have anything to 
say about the race or ethnicity of stu^nts,^ and only 10 per cent 
define the economic level of students,^ 

When teachers are subjects — the one remaining school group mth 
much probability of being studied — the applicants are more negligent 
of details. Approximate sanple size is not given in 55 per cent of 
the cases, 7 These figures suggest the magnitude of the omissions of 
basic factual information in proposals. 



Research Design 



Applicants select a variety of designs to achieve the objectives 
of their proposed projects. As Table 3*5 shows, they most frequently 
use: 



1, Ejq^eriments or quasi-experiments 

2, Surveys 

3« Standardized achievement or psychological tests 
k* Tests developed for the study. 

The subject matter of a study influences the choice of design. 
Studies in psychology, English, mathematics, the physical sciences, 
music, and art rely most on standardized tests or tests developed for 
the research; studies in education or a social science other than psy- 
chology are particularly likely to use surveys (Table 3*6), 

Of greater interest, perhaps, is the absence of empty cells in 
Table 3«6, Each research design is used by a fair share of the re- 
searchers in every area, A comparison of the columns for psychology 
and education illustrates both the influence of subject matter on 
design choice and the variation of choice vri-thin a subject area. For 
example, 88 per cent of the studies in psychology use standardized 
tests; i|5 per cent, ejqjeriments; 32 per cent, a survey; 18 per cent, 
observational or developmental techniques; and 16 per cent another 
design. In education, the sixrvey is preferred (i;7 per cent); then 
observational or developmental technioues (38 per cent); standardized 
tests (3x per cent); another design (26 per cent); and last, e^qseri- 
ments ( 23 per cent) , 

^Appendix B, Table 3»2, 

^Appendix B, Table 3.3« 

^Appendix B, Table 3*ho 

"^Appendix B, Table 3,5, 

5o 







MLE 3.^ 

THE STUDY DESIGNS OF PROPOSALS VARY CONSIDERABLY 



Study design 


Proportion of 
proposals 


Ej5>eriment, quasi-experiment 


.36 


Survey (questionnaires, interviei-ra) 
Standardized achievement or psychological 


.35 


tests 


.32 



Tests developed for the study (e.g., 



aptitude, personality, achievement, 



etc, ) 


^ ^ 


,28 




Developmental design (e, 
ulm innovation) 


g,, for a currric- 


,16 




Documentary or secondary analysis 


.16 




Observation 




•Ik 




Other (e,g,, sociometry, 


case study) 


,06 






TOTAL 


1,83’'" 


(6k9) 




Not specified or 
not applicable 




16 








665 



'Total exceeds 1,00 because more than one stucty design 
;^as specified. 



Modes of Analysis 



The many vjays that applicants intend to analyze their data are 
detailed in Table 3»7» One- third of those who do specify the modes of 
analysis plan to rely on tests of significance^ another 31 per cent, 
analysis of variance; and 28 per cent, correlation or regression 
analysis. For the remaining quantitative techniques the proportions 
drop sharply, reflecting an inverse relationship between complexity of 
technique and frequency of use. 

The disquieting element in Table 3«7 is the number of omissions, 
T"wenty-seven per cent do not state any plans for analyzing the data. 

In this instance, the instructions in the Guidelines may be a factor. 
Applicants are not explicitly instructed to describe the planned modes 
of analysis in the study design section of their proposals. When the 
Guidelines are revised, this oversight should be corrected. But the 
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Totals exceed 1,00 because more than one design vjas indicated, 



TA.BLE 3.7 



TESTS OF SIGMIFICANCE OR ANALYSIS OF VARIANCE ARE 
THE MOST FREQUENTLY MAMED MODES OP ANALYSIS 



Modes of analysis 


Proportion of 
proposals 


Tests of significance (e.g., t tests, 
chi-square ) 


.33 




Analysis of variance 


.31 




Correlation or regression analysis 


,28 




Descriptive-nonanalytic analysis 


.19 




Qualitative or historical analysis 


.17 




Analysis of covariance 


.12 




Factor analysis; cluster analysis 


,08 




Discriminant function analysis 


,02 




Other (e,g., item analysis, systems 
analysis) 


,o5 




TOTAL 


1,^5“ 


0il7) 


Not specified 




169 


Not applicable 




_79 






665 



'*Total exceeds 1.00 because more than one mode of 
analysis "was planned. 



absence of a specific instruction, however, does not justify the high 
proportion of applicants omitting a discussion of the analytical tech- 
niques to be used. 

To some extent, one missing detail leads to another. Many appli- 
cants fail to state how they intend to process their data. As Table 
3,8 shows, this is the case for 2h6 of the 66$ applicants (37 per cent). 
Virtually all applicants who do specify the intended data processing 
technique /Till use a computer. 



Budget 




The present ceiling on USOE funds for RRP-supported research is 
$ 10 , 000 , and most applicants plan with this as the target. Table 3.9 



^3 



r** 
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TABLE 3,8 



PROPOSALS TMT SPECIFY THE MODES OF DATA 
PROCESSBIG BUDGET FOR USE OF A COMPUTER 



Modes of computation 
and data processing 


Proportion of 
proposals 


Computer 


.98 


Other (e.g., McBee cards, 
band tabulating) 


.02 


TOTAL 


1.00 (3U0) 


Not specified 


21|6 


Not applicable 


79 




665 



TABLE 3.9 




THREE OUT OF FIVE APPLICANTS REQUEST 
THE MAXMUM IN FEDERAL FUNDS 


Federal contribution requested 


Proportion of 
applicants 


^^5,000 or less 


.11 


15,001 - $7,000 


.11 


$7,001 - $9,000 


.19 


$9,001 - $10,000 


.59 


TOTAL 


1.00 (661i) 


No budget attached 
to proposal 


1 

665 



shows that 59 per cent of the proposals speciiy a federal budget be~ 
tween $9,000 and $10,000. In contrast, only 11 per cent request 
$5,000 or less. The fact that even this many researchers are able to 
conduct a project on such a modest budget raises the question of idio 
they are. 

It turns out that they are the applicants who intend using their 
projects for dissertations. A majority of this group request the 
lower levels of support (Table 3»10). 



TABLE 3,10 

LESS THAN OTE-HALF OF THE PROPOSALS INTENDED FOR 
DISSERTATIONS REQUEST MAXIMUPI FEDERAL FUNDS 





RRP proposal 


for a dissertation 




Requested federal contribution 


Yes 


No 




$5,000 or less 


.16 


.09 




$5,001 - $7,000 


.15 


.10 




$7,001 - $9,000 


.22 


.18 




s$9,001 - $10,000 


,U7 


.63 




TOTALS 


1.00 (159) 


1.00 (5o5) 

N = 


66U 




No budget attached 
to proposal 


1 

665 



Only h7 per cent of the applicants who intend their RRP research for 
dissertations request betiireen $9,000 and $10,000 in federal funds, 
whereas 63 per cent of those who do not intend their research for dis- 
serta+dons request this amount. Doctoral candidates seem to antici- 
pate that the size of their requests may influence their chances of 
being funded. 

Arriving at a total sura to request is just one aspect of prepar- 
ing a budget. The utilization of research dollars for specific items 
is also of interest. The budgets submitted in fiscal 1968 list the 
portion of the anticipated cost for each item that will be covered by 
either federal or local funds. However, there is no standard method 
for distributing funds from the two sourcesj and in effect, applicants 
are free to divide the costs as they choose so long as the request 



for federal funds does not exceed f^OjCOO. For instance, the cooperat- 
ing institution may assume the total cost of personnel, or computer 
time, or even indirect costs. Such arrangements produce the illusion 
that these items are cost-free if only the federal side of the ledger 
is reviewed. Accordingly, total costs are the basis for the analysis. 

Treating each budget item as a total results in the loss of 
caiies. Only 5?1 of the 66^ budgets contain the information necessary 
for analysis. Eighty-one budgetSnhave been eliminated because they do 
uot state the local contribution,^ and another thirteen could not be in- 
cluded because the budgets had become separated from the proposals. The 
available data are reported in Table 3«H^ first, as the median cost of 
the item, follox-jed by the proportion of the $71 budgets upon vdoich the 
calculation is based. 

The magnitude of the median cost at the top of the list — that for 
professional personnel — stresses its importance. All other direct costs 
are mere fractions of this amount and none reaches $1,000. Furthermore, 
it is the only project item appearing in every budget. Even items such 
as services and supplies, expected to be common among all projects, have 
not been reported by every applicant. But these variations reflect dif- 
ferent accounting procedures at cooperating institutions.^ 

The median total budget is $11, 19^, several hundred dollars over the 
amount provided by a maximum federal grant combined vri.th the minimum 
local contribution. This is only the half-way point in the distribution, 
^0 per cent of the total costs exceed this amount Tidth a few going as 
high as $^0,000--and even higher. An applicant receiving such strong 
support can choose among a greater number of alternatives in planning 
his project than- the applicant who has no more than a 5 per cent commit- 
ment from his institution. Although this minimvim standard for the local 
contribution is generally enforced, a maximum is not. Setting a maximum 
would tend to place more equal demands on the researchers. 



^In Plscal 1968 this information was a required part of the budget 
and application form; however, the procedure has been modified since 
that time. The local contribution is now being negotiated after a project 
has been approved for funding. There is no indication of the anticipated 
institutional commitment on either the title page or budget of each 
proposal submitted. XTithout this information, the true costs of the 
project are obscured; and in the present analysis, such omissions liave 
resulted in a heavy loss of cases — the federal budget alone does not 
represent the total cost of the project. 

^During the coding of the budget data, it -was observed that data 
processing, including coding and key punching, is frequently -under 
services rather than non-professional personnel and services. Indirect 
costs is another item applicants treat in different vays. Some do not 
use the category at all and instead apportion such costs among other 
ca-tegories« 
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TABLE 3.11 

THIC MEDIAN TOTAL COSTS OF BUDGET ITEMS 



Budget item^' 


Median 

amount 


Proportion of 
cases reporting 
item as a cost 


Direct costs 


Professional ’"ersonnel 




1.00 


Non-professional .personnel 


782 


.80 


Services and final report 


609 


.95 


Eqxiipment 


590 


.29 


Trave], 


U 20 


.77 


Employee benefits 


37U 


.80 


Suppl j.e s an d material s 


276 


.95 


C omm'unica t i on s 


90 


.67 


Indirect costs 


2,1^2 


.91 


MEDIAE! TOTAL BUDGET 


111, 19^ 


1.00 


Source of funds 


Local contribution 


|2,10U 


1.00 


Federal request 


9,2^7 


1.00 


TOTAL 




(571) 



’’''Ciim\ILative proportions for each item appear in 
Appendijc B, Table 3.6. 



“''Gases not listing the cost for an item have been 
eliminated from the distribution. 



If it is desirable to equalize the funds available for conducting 
the research Jind to limit the Program to truly small projects, then 
one other factor has to be taken into account. As Table 3.11 shows, the 
only other item in addition to professional personnel costs that absorbs 
a high proportion of the budget is indirect costs. This amount, $2,1^2 
represents about 20 per cent of the median budget. Table 3*12 summarizes 
the per cent of the total budget absorbed by this cost.^^ For l8 per cent 



^^Indirect costs are not calculated in a uniform manner by all 
institutions. To compensate for this variability, indirect cost propor- 
tions have been recalculated using the total cost of the project as 

^7 




TABLE 3.12 



m CENT OF BUDGET FOR INDIRECT COSTS VARIES 



Per cent of budget 
for indirect costs 


Proportion of 
proposals 
submitted 


10 per cent 


or less 


.18 


11 - l5 per 


cent 


.16 


l6 - 20 per 


cent 


.20 


21 - 25 per 


cent 


.19 


26 - 30 pel’ 


cent 


.17 


31 per cent 


and over 


.10 




TOTAL 


1.00 (5o8) 


None listed 


63 


No budget available 


13 


No local 


amount stated 


81 






665 



of the projects, indirect costs represent no more than 10 per cent of 
the available funds, but for 10 per cent of the projects, indirect costs 
amount to more than 30 per cent of the budget. The variations in the 
rates may be j rtly due to the types of charges entered as indirect 
costs. More important, they exaggerate differences in total project 
costs and as a consequence, diminish the amount of the federal grant 
available for conducting the research. In effect, not all researchers 
receiving §10,000 grants ob'bain equal amounts of project support. Under 
the circumstances, the Directors should consider providing a grant exclu- 
sively for the research and then arrange to reimburse the institution 
for furnishing essential services. 



the base. This sura is the most reliable figure available; the defini- 
tions of item categories have not been standardized and prohibit using 
total professional costs, or total salaries and images as the denominator 




Sigimary 



This chapter has described the proposals submitted by RRP appli- 
cants by presenting data concerning the subject matter, the educational 
level to be studied, the group to be studied, the research design, the 
modes of analysis, and the budget. In brief, these data show that the 
subject matter of RRP proposals is varied. The elementary and secondary 
levels are most frequently studied; students are the most popular object 
of proposed research, Fexsr projects center on the teacher, and virtually 
none on policy-makers, either chief administrators or members of the 
board. 



Every subject is explored in a number of vjays. All recognized 
design techniques are used. Hovjever, applicants who utilize the more 
conventional quantitative modes of analysis far outweigh those relying 
on qualitative methods , Even though most state that their data will be 
processed by a computer, fev; depend upon complex statistical or mathe- 
matical programs for the analysis. 

The median total budget is $11, 19^, Only one-half of the projects 
can be conducted for less than this amount, the assumed small-scale 
range. The other half exceed $11,19^ and a few projects reach $50,000, 

The primary finding, however, in this review of the proposals is 
the consistent failure of applicants to provide sufficient details abo\it 
their proposed projects. One-third of the applicants planning to study 
students do not estimate sample size; one-fovirth of the applicants do 
not state plans for analyzing the data; one-third do not specify how they 
iiriLl process the data; and one out of six do not prepare their budgets 
as required. The omission of this vital information negates efforts to 
evaluate projects. Furthermore, if only the federal portion of the 
budget is submitted, the actual costs of the proposed research can never 
be known and in a sense, the projects cannot be compared on an equal 
dollar basis. 
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CHAPTER POUR 



DEVELOPBIG THE PROPOSAL 



Beyond the instruction booklet issued by a granting agency, an 
applicant seeking funds for his research usually likes to sovind out 
his ideas and obtain some appraisal of his plan before he formally ap- 
proaches an agency. He may do this, for example , by discussing his 
proposed research X'ri.th a colleague. The exchange can lead to other 
sources, such as an overlooked article, a contact with someone x-jho has 
applied for a similar grant, or a substantive specialist idio is mll- 
ing to go over a draft of the proposal. These examples suggest that 
much can happen between the time a researcher first thinks of applying 
for a grant and finally transmits his proposal. 

How to xnrite a research proposal is, of course, easier said than 
done. The USOE Regional Research Program (RRP) Guidelines , urge the 
applicant to be "clear, concise, forthright, and complete,"^ an injunc- 
tion which applies to all expository writing. But how one achieves 
the desired degree of perfection is not explained. Hopefully, docu- 
menting the experiences of applicants x-jill be instructive for those 
contemplating submitting a proposal, for the RRP, and for scientists 
interested in the process of sorting the ideas that get researched 
from those that are aborted. 

In this section x-je xiill ccamsider hoxj’ applicants hear of the RRP, 
at xjhat point in time their research plans are formxolated, and the 
type of resources they use in preparing the proposal. Lastly, we 
x-jill discuss the housekeeping aspects of proposal development: the 

clerical costs, x-iho bears the expense, and the number of man-hours 
spent preparing the proposal. 



Finding Out About the RRP 

Since oxir sample is composed of educational researchers applying 
to only one granting program and does not include researchers in 
general, i-je cannot gauge the number of potential applicants, ¥e do 
knoxj, ho'wever, how several hundred learned about the Program, Indeed, 
as Table [|,,1 shox-is, sources of knowledge about the Program are varied: 
(l) xjord of mouth from a colleague or superior^ (2) personal contact 
xvith a USOE officialj (3) oral presentation or X’jritten materials pre- 
pared by agency personnel; and (k) announcements in professional publi- 
cations. 



^Guidelines , op, cit,, p, 1^, 
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TABLE Ii.l 



APPLICANTS LEARN ABOUT THE RRP EROM A COLLEAGUE OR SUPERIOR 



Source of knowledge about RRP 


Proportion of 
applicants"'^ 


Colleague; superior; dean 


,6k 


Personal contact with USOE official 


CM 

H 

• 


Oral presentation by USOE official or 
USOE xTritten materials 


.10 


CORD (Consortium Research Development) 


.02 


Other (e.g., AERA Newsletter) 


.07 


Cannot recall 


.10 


TOTAL 


i.oy 




(658) 


NA = 


7 

665 



‘Tables in this chapter compare the funded and the not 
funded applicant, only x^hen the data shox-j a difference be- 
txreen these two groups. 



'Total exceeds 1.00 because each applicant coxfld name 
more than one source. 



As may be seen in Table I 4 ..I applicants are likely to hear about the 
Program from a colleague or superior, 

A chief reason for regionalizing the Small-Projects Program is to 
enable direct contact betxreen USOE personnel and potential applicants, 
as well as betx.-een the Directors of Educational Research and the funded 
researcher. All of the Directors of Educational Research agree that 
"going into the field," as they put it, is one of their most important 
functions; but as they told us, the' scarcity of funds severely limits 
this type of activity. For example, one remarked, "In this region ... 
there has been a constant freeze on travel for the three years that I 
have been here." It is quite likely that only a limited nximber of appli- 
cants learn about the RRP from a USOE official because of travel freezes. 



61 



Fomulatinp; a Research Plan and 
Applyjjig for Funds 



News of available funds from a granting agency may serve as a 
stimulus to the potential applicant fP'P .generating an idea into a re- 
search plan, or it may prompt him to move ahead iTith the plan he has 
been working on so that he can apply for support immediately. Appli- 
cants for RRP funds are in the latter category; that is, they state 
that they had a well-defined research plan before they thought of 
apolying to the RRP® 

To be precise, as can be seen in Table i|«2 belovx, Skh out of 6$8 
applicaiats (83 per cent) had formulated research plans prior to 
thinking of submitting a proposal to the RRP. Correlating the time 
the research idea was formulated vdth the disposition of the proposal, 
we find tliat the early formiflators are the ones being funded (1|0 per 
cent). This finding suggests that the RRP provides support for 
promising research ideas waiting to be tested. Without RRP, these 
ideas might remain in the mind of the researcher — and, in a sense, 
become lost Icno-tiLedge. 



TABLE k^2 

APPLICAI^TS VJITH tJELL-DEFINED RESEARCH PLAI’^S BEFORE THEY THINK 
OF APPLYING TO RRP ARE MORE LIKELY TO BE FUfDED 



Stage of research plans and 
timing of appl"^ cation 


Proportion 
of applicants 
funded 


Number of 
applicants 


Well-defined before thinking of 
applying 


,iiO 


(^) 


Only general idea before think- 
ing of applying 


.30 


(93) 


Developed research plans after 
thinking of applying 


.2li 


(21) 


TOTAL 


.38 


(658) 


■ NA = 




7 






665 



Proposals, just as joiimal articles, can make the rounds. Thus, 
it is plausible that many applicants submit their proposals to other 
agencies before taking them to the RRP, However, we know that 
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relatively fevr applicants had, in fact, gone elsewhere. 

The applicant questionnaire contained the following item: 

Had you previously jmbmitted a similar proposal to a 
funding agency? 

(Item #12) 

The figures in Table show that four out of five applicants 
had not done so, 

TABLE U.3 

EEl'ER THAW ONE BI FIVE APPLICANTS SUBMITTED A 
SIMILAR PROPOSAI. TO ANOTHER FUNDB\IG AGENCY 



Similar proposal submitted 
to another agency? 




Proportion of 
applicants 


Mo 




.83 


Yes 




.17 




TOTAL 


1,00 (661) 




NA = 


\ 

66$ 



Here we have another piece of evidence that the RRP provides support 
for those interested in research on education, but vjho ha^/e not tried 
to market their plans elsevjhere. 

Resources 



No matter hm-/ ■ /ell- defined a research plan may be, when an appli- 
cant prepares tte proposal it is helpful to have supplementary mate- 
rials at hand. As a miiaimuun he needs printed materials from the 
granting agency. This may seem too obvious to mention^ but, as we 
shall see, not every applicant has this essential information. Then, 
if the applicant is ine::^erienced in proposal >rriting, he may find it 
helpful to have copies of proposals submitted by other researchers to 
idiich he can refer. Finally, even those with e:;qjerience find it use- 
ful to consult someone knoxiedgeable about granting agencies regarding 
a time -schedule and budget. 

Applicants were asked about both the resources available at their 
institutions and the resources they used while preparing their pro- 
posals, The answer options \7ere presented as a check-list. Table 



shows tihe items listed as well as the proportion of applicants who 
nave 'each resource available. 





TABLE h.k 






USOE "GUIDELraES" AND A "RESOURCE PERSON" 
AVAILABLE TO MOST APPLICANTS 


ARE 











Resources available 


Proportion of 
applicants 


1, 


USOE "Guidelines for Small Project Research" 


-97, 


2, 


A "resource person" knowledgeable about apply- 
ing for research funds 


,72 


3. 


Copies of proposals submitted by others 




h. 


Sample application forms of funding agencies 


»kh 




An "information bank" of agencies that fund 
research 


.w 


6, 


ERIC materials 


.33 


7. 


USOE "I'Jinning a Research Bid: Tips on Proposal 

Writing" 


,10 




TOTAL 


3.31'^ (621) 




No resources available 


31 




NA = 


13 







665 


one 


^^otal exceeds 1,00 because each applicant could 
resource. 


name more than 



Approximately three resources are available for each applicant. 
The USOE "Guidelines for Small Project Research" is at the top of the 
list, but it is woith noting that 13 per cent of the applicants do not 
have this reference available. Next in line is a resource person 
knov/ledgeable about research procedures; 72 per cent of the appli- 
cants are at institutions which have such a person for consultation 
about application procedures. Notice too that at the bottom of Table 
there is a line reading "No resources available"; 5 per cent of the 
applicants are in this resource-poor group — not one of the seven 
resources is available to them. 

When we consider which of the available resources are actiiaJ-ly 
used, we have a measure of their relative importance as an aid to the 
researcher in the preparation of a proposal. Moreover, these same 

wMch v^n(j»«x‘ces should be available at every institution. 
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Table Ij.Ij shOTjed that the IBOE "Guidelines" and a. "resource per- 
son" are avai].able to most applicants, and Table ko^ beloxi reveals 
that aLnost every applicant having access to these resources puts them 
to use. 



TA.BLE I;, 5 

APPLICANTS SELECTIVELY UTILIZE RESOURCES 





Resources utilized 


Proportion of 
applicants 
utilizing resource 


Nvunber of 
applicants xjith 
resource 


1. 


user "Guidelines for Small 
Project Research" 


.95 


(5UU) 




2. 


A "resource person" knox7l- 
edgeable about applying for 
research funds 


.39 


(hhl) 




3. 


Copies of proposals submitted 
by other's 


• 

CD 

ro 


(281) 




u. 


Sample application forms of 
fundiiig agencies 


.75 


(272) 






USOE "Uinning a Research Bid: 
Tips on Proposal Writing" 


.67 


(67) 




6, 


An "information bank" of 
agencies that fund research 


.56 


(2li9) 




7. 


ERIC materials 




(265) 






Number of 


applicant responses 


(2065)'' 






Number of applicants using at 
least one resource 




597 




Number of applicants using no 
resources 




55 






MA. = 




13 










665 



%umber of responses exceeds number of applicants because inany 
applicants used more than one resource. 



More interesting, perhaps, is the finding also in Table that 62 
per cent of the applicants review proposals TO’itten by someone else in 
tJieir search for help. Returning to the data in Table h»hj we see 
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that only lj5 per cent of the applicants have access to such a resource. 
The fact that this resource is heavily utilized by the limited number 
having such a file available suggests that this is a valuable resource. 
The Directors of Educational Research might encourage the institutions 
with Tdiich they are in contact to incorporate such materials in their 
reference collections. Sample application forms from funding agencies 
are another source of information frequently I’sed, Even though this 
type of material is available to less than half the applicants, 7$ per 
cent take the time to review the file. 

More generally, the data on resources— both those available and 
those used— can serve as a guide for the Directors of the RRP as they 
endeavor to help applicants and institutions develop their research 
potential. Indeed, it is the availability of a resource at an appli- 
cant's institution more than his use of any one resource that is re- 
lated to funding. This information may be seen in Table U*6 which shows 
the proportion of applicants funded: first, according to their access 

to a particular resource and second, according to their use of it. 

For five of the seven resources listed, applicants who have the 
resource available are more likely to be funded than those who use it. 
For example, k7 per cent of the applicants who merely have access to 
ERIC materials are funded, whereas only 38 per cent who use these 
materials are funded. One more point, k3 per cent vdio work at an 
Institution having an "information bank" available beceme successful 
applicants, but this figure drops to 3^ per cent for those who make 
use of it. 

More dramatic perhaps are the data in Table U,6 for the applicant 
vdthout even one of the seven listed resources. Just 10 per cent of 
these applicants are subsequently funded — striking evidence that the 
applicant working in a barren environment is left behind. In fact, 
applicants who have resources available, but who choose to ignore 
them, fare better: 18 per cent are funded. 

At first glance, the findings in Table Ii.,6 seem anomalous. VIhy 
should the availability of a resource count more in funding than the 
applicant's actual use of it? We suggest that wliether an applicant 
uses a particular resource can depend on a number of factors, for 
example, his previous ejqDerience XTriting proposals, how well-defined 
his research plan is, or how e^cteneive his research training has been. 
But the availability of resources at the institution with xdiich he is 
affiliated is crucial. This measure is an indicator of the research 
orientation of the institutional setting. 

Our data support this reasaiing. An applicant's cliances of being 
funded appear to be related to the number of resources available to 
him, 2 Only 36 per cent of the applicants xdth a single resource at 




^Appendix B, Table ij..l. 
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TABLE lt.6 



HAVING A RESOURCE AVAIUBLE, ilORE THAN UTILIZING 
IT, INCREASES TIE CHANCE OF miDItJG 





Available 


Used 


Resource 


(Proportion of 
applicants funded) 


1. ERIC materials 


•h7 


(20^) 


.38 


(99) 


2, An "information bank" of agencies that 
fimd research 


•li3 


(2h9) 


.35 


(ll|0) 


3. USOE "Guidelines for Small Project 
Re search" 


.III 


(^hh) 


.IpL 


(516) 


It.. A "research person" knowledgeable about 
3-PPlyirg for research funds 


.liO 


(hk7) 


.liO 


(397) 


Copies of proposals submitted by others 


.liO 


(281) 


.37 


(22.8) 


6. USOE "Winning a Research Bid: Tips on 

IVoposal Writing" 


.39 


(67) 


.31 


(Ii5) 


7. Sample application forms of funding 
agencies 


.3^ 


C\J 

C\J 


.30 


(203) 


No resources 


.10 


(3i) i 


.18 


(55) 


Number of applicants who provided 
on available and used resources 


information 




652 






NA 




13 










665 



their disposal are funded, but the percentage increases to per cent 
for those vjith five resources at hand. No such pattern, hovrever, 
exists betTxeen funding and utilization of resources (Table ii.?). For 
example, k7 per cent of the applicants who use two. resources are 
funded, but only 33 per cent of those using four are successful. In 
fact, not one of the few applicants using all seven resources is 
funded. 

life vjant to consider one other resource utilized by some appli- 
cants that is qualitatively different from those just described, 
namely, inforrailly discussing one's proposal xjith a USOE official 
before submitting it. Typically, these applicants contact the Direc- 
tor of Educational Research in their regions, although a few turn to a 

67 
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lABLE U,7 



APPLICAJnITS \#io use mny resources have no more 
CHANCE OF BEII'IG FUT>IDED THAN THOSE IJHO USE FEI-J 



Number of resources 


Proportion 

used of applicants 

ftinded 


Number of 
applicants 


One 


,/j.2 


(138) 


Two 


.U7 


(1?0) 


Three 


.3^ 


(152) 


Four 


.33 


m 


Five 


,U6 


ihS) 


Six 


.33 


(21) 


Seven 


[0] 


(6) 




TOTAL 


(597) 




No resources used 


55 




NA = 


13 






665 



Note : Bracketed nuinber refers to the actual number 

of funded applicants where there are too few cases for 
determining proportions. 



staff member in Washington,^ Our 'data indicate that two out of five 
applicants have this kind of help, and that these applicants are more 
likely to be funded than the cnes i\ho do not consult a USOE official 
(Table 

Not une:,'{pectedly, funded applicants find the discussion helpful; 
applicants not fundad think othenn.se Herein lies the difficulty of 
having an official of IBOE discuss an applicant’s proposal tvith him 
prior to submission. In his desire to be funded, an applicant may 
interpret suggestions offered by the Director of Educational Research 
in his region as an informal commitment to funding. If nis proposal 
is subsequently not funded, such an applicant can feel bitter. 

One said: 



^Appendix B, Table 1;,2, 
^Appendix B, Table ii,3. 
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TA.HLE U.8 



AffLlCAffl’3 MiO DISCUSS THEIR PROPOSAL UITH 
A USOE OFFICIAL BEFORE SUBMISSION ARE 
MORE LI^OSLY TO BE PUI€)ED 



Discussed proposal 
xd-th a USOE official? 


Proportion 
of applicants 
funded 


Number of 
applicants 


Yes 


.Ii3 


(268) 


Wo 


.32 


(392) 


TOTAL 


.38 


(660) 




WA = 








665 



I got nothing biit encoioragement foUox\red by a brush- 
off [x-ihen the proposal x-jas rejected]. 

Another remarked; 

After improving the format and doing more bibliographic 
X'jork, the proposal Xrjas returned rejected This x^as 
disheartening to say the least* If they hadn’t told us 
initially that it xjas a good idea i-re X'Xould have felt 
less bitter about the xxltimate rejection. 

The Directors of Educational Research are ax^are of the tightrope 
they xjalk x-ihen they tal.k xath an applicant about his proposal before 
submission. As one Dir'ector of Educational Research said: 

You have to be mighty careful in the kind of help that 
you give. It’s easy to get into trouble. They [appli- 
cants] can’t be led to expect that just because you en- 
coxuraged them, it xjill insure their getting funded. 

At the same time, several consider helping applicants to be an impor- 
tant part of their x-xork. They are particxxlarly concerned about the 
less experienced applicant x-iho lias no resoxxrce person at his institu- 
tion, The help Directors of Educational Research offer such an appli- 
cant includes talking xxith him about his research ideas, referring 
him to a consxiLtant nearby, and commenting on an outline or sxommary 
of the proposal before it is formally submitted, 
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An applicant i^ho discusses his proposal vjith the Director of Edu- 
cational Research in his region and is then turned dox-m requires 
special attention niien he is informed of the decisiont A form letter 
notifying him that his proposal is not going to be funded is apt to 
leave him embittered. Although some applicants probably cannot be 
mollified, it xrould seem that many could be, if only the Director of 
Educational Research X7ould take time to contact them on a more per- 
sonal basis and give them constructive criticism of the proposal*^ 

In fact, txra not funded applicants volxuiteered appreciation of just 
tliis kind of help. 



I think [a regional intern in this iixstance] 'caught 
my purpose' At no tie did he make me feel inade- 
qxiate because of lack of experience or recognition in 
research. He gave me outstanding guidance for improving 
my research design. 



The regional office offered useful suggestions W 

proposal was turned doxgn], I was more or less disgusted 
x:ith myself for not having taken more time to do a 
respectable job. 



In offering the suggestion that Directors of Educational Research 
give special attention to some applicants, x-re are not overlooking a 
concomitant problem confronting the Directors every day, namely, the 
limited— or ex/en complete lack of— clerical and professional help in 
the regional offices. This matter is being deferred until the next 
chapter as x-je xd-sh to conclude this chapter by revievdng briefly the 
data collected on the time and clerical costs of developing a proposal 
for small-project research. 



Time and Cost 



We asked applicants about a fe'W practical matters connected xdth 
developing their proposals. To the best of our knoviLedge no system- 
atic information e:dsts on the number of hoxirs an applicant spends 
P 

•^"Constructive criticism of the proposal" usually has meant tl'pd 
the Director of Educational Research or an assistant selectively ex- 
cerpts comments i/nde by field readers. Doing so, hoviever, places the 
Director of Educational Research in the role of judge and can imply 
that he is an "unquestioned expert in every aspect of the research 
process. An alternative is directly transraitting field reader com- 
ments, making the field reader responsible for coBBramicating his evalu- 
ation rather than the Director of Educational Research, See Chapter 5 
for a discussion of this idea from three perspectives, that of appli- 
cants, field readers thernselves, and the Directors of Educational 
Research, 



70 






■preparing a proposal, X'jhether he does the drafting on his own or on 
working time, tjhat the clerical costs are, or who underwrites this 
expense. 

We asked applicants; 

Altogether, about how many hours did you actually spend 
preparing the proposal? 

(Item #23) 

Their answers ranged from less than two hours to more than 200, The 
median time was U8 hours, a week’s work,° 

There is some relationship between the amount of time spent pre- 
paring a proposal and its likelihood of being funded. Applicants 
who spend less than 20 hours on their documents are least likely to 
be funded (33 per cent); those who spend i)l-60 hours are most likely 
to be funded' ([|1 per cent). However, applicants who labor as long 
as 100 hours, more than two weeks' work, are less likely to be 
funded (38 per cent)."^ 

Typically applicants prepare proposals on their own time. Only 19 
per cent do so on working time,° Thus, we know that applicants extend 
themselves beyond their regular work day to develop the proposals they 
submit to the RRP and that, by and large, they spend a considerable 
amount of time on the documents. 

We also asked a question about the clerical costs of preparing 
the proposal: 

It is difficult to calculate a precise figure, but vHnat 
would you guess the clerical costs of your proposal 
amounted to? 

(Item #22) 

The median cost is (pUS, although applicants spend anywhere from 
less than $2^ to more than $100, ^ As it turns out, however, the cost 
of preparing the proposal document is not related to the probability 
of being funded (Table l4.,9)« 



'^Appendix B, 
7 

‘Appendix B, 

O 

“Appendix B, 
9 

Appendix B, 



Table I;,!;, 
Table 

Table l 4 ., 6 . 
Table I;,?, 
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TABLE h*9 



THE CLERICAL COSTS OP PREPARING THE 
PROPOSAL ARE NOT RELATED TO PUNDING 



Clerical costs of 
preparing the proposal 


Proportion 
of applicants 
funded 


Number of 
applicants 


$100 or more 


.38 


(121) 


$50 - $99 


,ko 


( 169 ) 


$25 - $h9 


*37 


( 193 ) 


Less than $25 


.35 


( 136 ) 


TOTAL 


.38 


(619) 




NA = 


U6 






665 



Table I 4 ..IO shows that few applicants personally pay the clerical 
costs of preparing the proposal, The applicant’s department or 
institution usually absorbs this expense, and this suggests depart- 
mental support of the activity. 

In addition, Table 1;«10 shov/s that the clerical costs are seldom 
met by another research project, indirect evidence that few applicants 
are engaged in an on-going project. However, the few applicants i^hose 
clerical costs are absorbed by another project have the highest fund- 
ing rate (Table If.,!!'), Conversely, ^plicants who personally pay all 
clerical costs have the lowest funding rate. Here again, we have evi- 
dence that the applicant on his own has less chance of getting started 
than the one who can count on the support of his institution. 

Summary 

This chapter has considered the applicant’s experiences while 
developing his proposal for submission to the RRP, In particular, it 
has reported how applicants learn of the Program, whether they formiu- 
late their research plans before thinking of applying or not until 
aften-zards, the type of resources at hand, and those used in addition 



^*^The question x-jas xzorded: 

T'Jho paid the clerical costs of preparing the proposal? 

(Item #21) 

The ansx-rer options were: (l) department or institution; 

( 2 ) another research project; (3) personally; and (4) both institution 
and personally. 



TABLE li.lO 



TPIE .'IPPLICAIJT'S DBPARTHEnT OR DISTITUTION 
USUALLY PAYS THE CLERICAL COSTS 



Vflio pays the clerical costs? 


Proportion of 
applicants 


Department or institution 


.7U 


Applicant 


.20 


Both institution and applicant 


.Oli 


Another research project 


.02 




1.00 (66l) 


NA = 


h 




66$ 



TABLE li.ll 

THE APPLICANT llEO PERSa'IALLY PAYS THE CLERICAL 
COSTS IS LEAST LIKELY TO BE PUNDED 



Elio pays the clerical costs? 


Proportion 
of applicants 
funded 


Number of 
applicants 


Another research project 


.50 


(16) 


Both institution and applicant 


,hh 


(25) 


Department or institution 


.39 


(li88) 


Applicant 


.33 


(132) 


TOTAL 


.38 


(661) 




NA = 


U 






665 
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to the time and clerical costs of preparing the dociunent. 

The data show that a colleague or superior rather than a USOE 
official is the applicant’s source of information about the Program* 

It is also apparent that more often than not applicants have woll-de- 
fined research plans before they think of applying to the RRP^ and it 
is these individuals xdio are most likely to be funded. 

In addition, x^hen they prepare their proposals, most applicants 
have copies of the USOE "Guidelines" a'vailable and access at their 
institution to a resource person kno-viLedgeable about seeking research 
funds. Less tnan half the applicants, however, have the various other 
resources such as copies of proposals previously submitted by others, 
sample application forms of funding agencies, or ERIC materials. More 
important, the likelihood of being founded appears to be related to the 
type and number of resoxirces available to applicants rather than to 
which resources or hox^ many x-rere actually utilized. Finally, the 
probability of being funded is greatest if another project absorbs the 
clerical costs of preparing the RRP proposal. 



CHAPTER FIVE 



PROCESSII'IG THE PROPOSAL 

Once the researcher has prepared the fiiial draft of his proposal, 
the next step is to submit the required niunber of copies to the grant- 
ing agency. At this point the researcher becomes an applicant, his 
proposal is assigned an identification number, and processing begins. 

In our discussion of the applicant's experience, statrstical data 
xiill be supplemented by comments from applicants f.jho voluntarily ex- 
pressed their viex;rs. Some T-rere favorably impressed by the my the 
regional offices processed their proposals; but many, as m shall see , 
i-rere critical. Miether positive or negative, their statements enpha- 
sized first, the length of time from submission to notification of 
final disposition and second, the e.'cplanation given for the granting 
decision. 



Length of Time 





One reason for creating regional offices was to streamline the 
processing of proposals so that the time lapse betvreen submission and 
notification of the funding decision would be shortened. Unlike many 
other granting agencies, the USOE Regional Research Rrogram (RRP) has 
no deadlines for submitting proposals. The Guidelines state: 

Processing of proposals from receipt to notification of 
action is usually completed within two months, except 
when complications beyond the control of the Regional 
Office arise yf LSmphasis added. j 

The goal of rapid processing is withoiit doubt laudable, but for 
a variety of reasons, only a limited number of applicants profit from 
it. In PY '68, the year of this study, two-thirds of them waited 
longer than they had e:^ected to learn the disposition of their pro- 
posals (Table 5.1). 

Although a sirple check -mark ivas all that I’jas needed to answer 
the questionnaire item about the length of time for processing, many 
applicants t-jrote letters to present their e^^Deriences in greater 
detail while others jotted notes in the margins of the questionnaires,^ 

•t 

• ^Guidelines, op. cit. , p, 6. 

p 

Some applicants did not complete the questionnaire but chose 
instead to send notes berating us for asking them to fill it out. Each 
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TA.BLE 



THE MAJORITY OF APPLICANTS WAIT LONG-SR TIM 
EJCPECB3D FOR THE RJl'IDH^G DECISION 



Length of time for 
funding decision 


Proportion of 
applicants 


Considerably longer than 
expected 


.liO 


Somexdiat longer 


.27 


About x-xhat expected 


.2;? 


Less than erqjected 


,o5 


TOTAL 


1,01 (6^8) 


NA = 


7 




665 



A few examples ^-jxll illustrate the difficulty. 

It took approximately 6-8 months to find out tliat my 
proposal T-jas not funded. Several calls W3re iricide by 
my advisor to no avail. At one t;ime no one Icnew the 
whereabouts of proposal, 

I t-jas told that the grant application would be pro- 
cessed within 3 months. Instead, it took .11 months. 

Inquiries xrere made and I was led to bellex^e that 
action x-hs imraineat. For hand-to-mouth exj.sters, 
like academicians, this is especially important. 

It x-jas ? months before I x/as told there xrould-be no 
money. The constant granting and x^ithdraxdng of 
funds from OS programs makes dealin.g xdth them like 
Rxissian roxxlette. 



expressed the feeling that after taking time to xjrite a proposal and 
xjaiting endless x-xeeks to learn that he had been txarn(jd doxm, he had no 
interest in ansx-jering questions about the rejected proposal, 

A typical note came from a minister: “This addj; in,jxiry to insult, 

life telephoned this applicant, as well aS the others xrho sent similar 
notes, to suggest that it was better to register thej.r complaints on 
the questionnaire than to x-nrite off USOE, Almost every one of these 
applicants "took our advice" and returned completed questionnaires. 



Regional offices can process proposals 'within a shorter period of 
time except v:hen "complications beyond the control of the Regional 
Office arise," as the Guidelines state. The 'word "complications" is 
a euphemi'^m covering problems such as budget freezes and understaffing. 
2cth plf.gued FY *68 and continue to handicap the Program. 

In fact, tho Program has yet to have a "typical" 5 rear. Budget 
freezes tjhich negate any attempts to plan even a fetr months ahead may 
be imposed at any time during the fiscal year. This "clamping a lid 
on funds," as one Director of Educational Research phrased it, "can 
mean no travel, no convening of a panel [to re'view proposals], even no 
mailing of proposals fctr indi'vldual reviews." 

Good business practice calls for informing the cxistomer, in this 
instance the applicant, of the budget freeze and the consequent delay 
in processing his proposal. But a second major problem, namely, mini- 
mal clerical and professional staff makes this all but iinpossible. 
tJhen the regional offices opened, the Directors of Educational Research 
were promised staff assistants, but continuous cuts in appropriations have 
never permitted filling these positions. 

Visits to the regional offices and Washington, in addition to 
inter '/'lews \jith the Directors of the fi’ogram, revealed how acute 
understaffing is for the RRP. The enormity of the problem is perhaps 
best conveyed in the words of some Directors of Educational Research: 

I*ve had to beg, borrot-r --^nd steal clerical help. I*ve 
had no one fill-tiiiie ... bJhen someone is free, I grab 
them and get ohem to do some of my correspondence. 

I hate to make the old cry of adeqviate help. My secre- 
tariau help is part-time, hit or miss. 

It makes me mad to even hear you [interviewer] raise 
the topic of office help, 

A lot of the time I don’t have the opportunity to do 
an;d>hiig but s'tack the piles a little higher. 

It is only fair to add tliat three Directors of Educational Re- 
search do have adequate clerical help, 

I've got an efficient secretary. She’s half-time i-jith 
me, but she vjill pick up the phone all day. 

We get along fairly vrell xjith what we have , and, of 
course, we’re so much better off than they [Directors 
of Educational Research] are in other regions, 

I’m lucl'cy, I’ve had a half-time girl ever since I 
started. 
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Adequate clerical help would relieve the Directors of Educational 
Research of the routine tasks that they now are forced to neglect. 

But a clerk would only partially solve the problem. The Directors 
also need professional assistance, as thej'' readily point out«, 



I need someone at the intermediate level ... Tliis wo'old 
permit me to go into the field to work ^m.th the insti- 
tutions that don’t have research potential now. 

I surely could use more help — someone xd.th competence 
who can rac,ke decisions. It is hard to be a one-man 
operation and try to do the job timt needs to be done. 



It is not news to anyone associated with the RRP that mderstaff- 
ing and budget freezes severely hamper the functioning of the Program. 
These two administrative probleias have been discussed at some length 
to underscore hox: adversely they can affect the processing of a pro- 
posal and accordingly, the applicant's image of the Program. 

Notification of the Granting Decision 

In addition to criticizing the RRP for the length of time it takes 
to process proposals, many applicants included criticisms of the way 
in which they were informed of the granting decision. Funded appli- 
cants confined their remarks to delayed confirmation of funding, bat 
not funded applicants were specific in their negative comruents about 
the treatment they received. Some of their difficulties can be attri- 
buted to the minimal staffing and budget freezes just mentioned— in 
other words, to circumstances beyond the control of the regional 
offices. Others may be interpreted as suggestions for improving the 
contac': between regional offices and applicants xjithout increasing the 
worlcloaid of the Directors of Educational Research, Again, x-ie have 
both statistical data and voluntary comments. 

Applicants who x-rere not funded were asked whether they requested 
an e^splanation of the granting decision and, if so, x-jhat they x-rere 
told, A total of 71 per cent responded ”yes" ' ” .estion; "Did 



tlxen indicated x;hat they had been told. Their ansx-jers may be seen in 
Table ^,2, 

Tlie ansvrers most frequently given x-jere that the stuc^ x-^as poorly 
designed or tlxat the proposed research lacked educational significance. 
These +■ •- qualities, along Xndth economic efficiency and adequacy of 
pers.ijnol and facilities, are used for evaluating small-project pro- 
posals. It is of interest to note that neither one of the last tx-JO 
criteria is often cited as a reason for not funding a proposal, 

^Appendix B, Table 5,1, 



you ask for an ejcplanation of the [funding] 




The applicants 
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TABLE ^,2 



ONE OUT OF FIVE NOT FUI'IDED APPLICANTS VJHO 
ASKED FOR AN EXPUWATION OF THE FUNDING 
DECISION FAITJID TO RECEI'/E ONE 



Why proposal tras not funded 


Proportion of 
applicants 


Qualities criticized; 




Soundness of design 


.39 


Educational significance 


.32 


Economic efficiency 


.07 


Adequacy of personnel and 
facilities 


. 0 ? 


Other (e,g,, review of literature) 


.oU 


Other explanation: 




No explanation provided 


.21 


No RRP funds 


.13 


Conflicting priority (e.g,, Tidthin 
ERIC/CRIER) 


.0^ 




1 . 26 ’'^ ( 272 ) 


NA = 


21 


Cases exclude d^^^ 


121 




251 




665 



'Proportions exceed 1,00 because some applicants 
gave -inore than one reason. 



^Tlot funded applicants Ti;ho did not ask for an ex- 
planation ( 121 ), and funded applicants (2^1), 



It is not the pinpose of this study to evaluate the reasons for 
not funding an applicant's proposal. We simply report them as part of 
the data collected, and sometimes these data contain disturbing ele- 
ments, In particular, x-je want to consider the finding in Table ^,2 
that 21 per cent of the applicants received no explanation of the 
granting decision, even after asking for one, 
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The follouing are examples of the exjoerienees these applicants 
had ivhen they tried to discover the reasons for their rejection. 

All I got TOs a curt "this is not the type of thing 
the small projects can fund" irith no indication as 
to vjhy, 

I OTote to see why my proposal was turned down and 
also wrote a follovr-up letter, but I got no reply. 

After I received the letter of rejection I wrote to 
the regional office asking for comments and to this 
day I have never heard one word from them, 

I never was officially informed of action taken, 

I'Jhen I finally called long distance ,,, I was told 
verbally that the proposal had been rejected. This 
ims the only information I ever received. 

Two applicants who were not funded described quite different 
treatment. 



The reply [to the request for an oj^jlanation] •was 
courteous, comraented on strong points, and ex- 
plained the reason for rejection, 

[The decision] t-Hs adequately explained by tele- 
phone and letter, I vjas pleased xvith the pleasant 
personal approach. 

These applicants, unfortunately, are the exception. Four out of 
five not funded applicants who asked for an explanation of the grant- 
ing decision were not satisfied x-jith the one they received, d It can 
be ar,gued that it is difficult, if not impossible in some cases, to 
present a convincing argxoment to the applicant who must be told that 
his proposal is not going to be funded. Yet the specific comments 
made by dissatisfied applicants are sxifficiently compelling to merit 
attention. 

In essence, eacn applicant complains about the qiaality of feed- 
back, After - devoting a full x-jeek of his time^ to the preparation of 
his proposal, he is given the "brush-off" by the regional office. As 
one applicant remarked: 

I franlcly don't see how an investigator can improve 
any future proposals xdthout obtaining a critique, 

^Appendix B, Table 5,2 

5 

Appendix B, Table U,lx, 
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?Voia oui’ contact idth the Directors of the Program, it is dif.fi- 
c\.i].t to imagine tha1i any would think an applicant is entitled to no 
more than a perfunctory letter infomdng him that his proposal is not 
funded. Pressures of time, lack of staff, and competing priorities 
probably account for such "treatment when it 'occurs. Yet, repeated 
phone calls and follow-up letters from querulous applicants also fur- 
ther curtail alread.y scarce office time. Moreover, the dissatisfied 
group is not a minority; 71 per cent of the not funded applicants had 
to ask for cm explanation^ — a figure higli enough to vjarrant consider- 
ing a basic change in RRP management. 



An Available Alternative 



We suggest that the method of notifying unsuccessful applicants 
be reviei-jed by the Directors of the Program in an effort to establish 
a more uniform policy, Toi-rard this end, we present data collected on 
a feasible alternative whidi we hope the Directors of Educational Re- 
search will take under advisement. This change involves sending the 
field, reader comraents directly to the applicant when he is informed 
of the funding decision. In order to adequately explore this idea, 

176 sought the viet'jijoints not just of applicants .for RRP funds, but 
also of field readers, and Directors of Educational Research, 



Vietjpoints of Applicants and Field Readers 

In ansvjer to the question: 

Do you th:ink that a copy of the comments made by 
field readers should be sent routinely to each appli- 
cant? 

(Item #26) 

almost every applicant said "yes," Moreover, as can be seen in Table 
5,3, applicants Trere equally likely to hold this opinion >jhether or 
not their proposals had been funded. 

This vieT.7point is not restricted to the applicants; the field 
readers themselves concur (Table To be specific, 59 per cent 

indicate tliat they favor sending such comments routinely to each appli- 
cant, If the 20 per cent who say the comments should be sent only to 
those who request them is added, a total of 79 per cent endorse this 
policy. In addition, vjb call attention to another finding in Table 
5 .U: field readers make no distinction between funded and not Jiinded 

applicants as recipients of their comments. Only 1 per cent think 
that comments shou.ld be sent only to applicants whose proposals have 
been rejected and another 1 per cent hold the opposite view, 

^Appendix B, Table 5 « 1 . 
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TABLE 5.3 



FIVE OUT OF SIX APFLICANTS THE'IK FIELD 
READER COMIEOTS SHOULD BE SENT TO THEM 



ShouI.d field reader 
comments be sent 
to applicants? 


Proportion of 
applicants 
funded 


Proportion of 
applicants 
not funded 


Yes, to every applicant 


• 

CD 


.87 


Yes, but only to not 
funded 


,06 


,08 


Yes, but only to funded 


.02 


.00 


No, not to any applicant 


,0k 


.01 


Yes, but only if requested 


,00 


.01 


No opinion 


.01; 


.03 


TOTAL 


1.01 (2i;8) 


1.00 (1|13) 


NA = 


3 ^ 


1 




251 


klh (665) 



TABLE 

FOUR OUT OF FIVE HELD xOSADERS THIi'ffi THEIR 
COMSNTS SHOULD BE SMT TO APPLICANTS 



Should field reader 
coiiiinents be sent 
to applicants? 


Prqportion of 
field readers 


Yes, to every applicant 


.59 


Yes, but only if requested 


.20 


Wo, not to any applicant 


.15 


Yes, but only to funded 


.01 


Yes, but only to not 
funded 


.01 


No opinion 


.ou 


TOTAL 


1.00 (hl9) 


NA = 


u 




U23 




Viotjpoints of Directors of Sducational Research 



We discussed rrith the Directors of Educational Research the pos- 
sibility of sending field reader comments to applicants before the 
results of both the applicant and the field reader surveys ^^ere tabu- 
lated, Tlius, the points of vieu the Directors express cannot be said 
to have been influenced by the opinions of either group. 

In general, the Directors of Educational Research favor sending 
field reader com'ments to applicants, but some have reservations about 
sending them to every applicant. The reasons for their hesitancy vary, 
but this is not unexpected. Each Director of Educational Research is 
an individual in his ovm right. However, as tre sliall see, their 
opinions do not diverge to such an extent that agreement is out of the 
question. 

At present tvro Directors of Educational Research routinely send 
field reader comments to applicants. As one said; 

I xerox the field reader coimnents, cut off the name 
of tlie investigator and any personal remarks he may 
have made. If the proposal has been revievred by a 
panel, I send t}ie investigator both the comments 
made by the panelist prior to coming to the meeting 
and then the consensus summation. 

The other remarked; 

All of these fellows [field readers] know that I’m 
going to send their conriients back to the proposal 
Tjriter There are very few instances when their 
comments should be tanpered viith. They might be a 
little cryptic, but this type of feedback doesn’t 
hurt either. 

Other Djurectors of Educational Research have reservations about 
routinely sending field reader comments to applicants. They cite four 
problems ; 

(1) Some applicants can identify the revievrer(s), 

(2) Some field reader comments can be difficult to 
interpret, 

(3) Some evaluations can be unnecessarily harsh, 

(I4.) Revievorers can have discrepant views. This, as 

one Director of Educational Research put it, 

"can be particularly bad for the unsophisticated 
researcher and can lower our field readers in 
their estimate," 

¥e will discuss each of these problons. 
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One Director of Educational Research anticipates that some appli- 
cants would be able to identify the field reader. Another found that 
this did occasionally occur when he sent out field reader comments a 
couple of years ago, so he stopped. Three others stated that they have 
had no repercussions; no applicant has ever reported that he recog- 
nized the haiadxrriting or point of viei-r of an evaluator. One of these 
Directors did add that he has had tvio requests for the identity of 
reviewers, but as he said, ''the law alone protects me from such a re- 
quest," And finally, fears should be abated by the knovfLedge that 
field readers, the individuals central to the issue, are not at all 
concerned about this matter; not one mentioned it as a potential 
threat, not even those voicing an objection to sending their comments 
to applicants. 

Ambiguity and lack of clarity in the coiTiraents of field readers 
can also pose a problem. To avoid this, some Directors of Educational 
Research analyze the comments, delete those that are beside the point, 
and summarize the salient ones. But this too can be difficult. 

First, tliis is a tiine- consuming activity for a Director of Educational 
Research already overbua'’dened xrith clerical wrk. Second, as one 
Director said: 

The ideal time to furnish feedback to applicants is 
immediately after, say, the panel meets. But this is 
not possible for proposals that go on the approved 
list. The longer tlie time lapse, the more rusty you 
get in what you remember and often there are points 
that have to be elucidated a little bit more than the 
notes you've kept. 

Thus, to write a coherent summary of the evaluation, a Director of Edu- 
cational Research may have to completely revievx the contents of the 
applicant's file before co’aposing the letter. 

One Director of Educational Research vrho sends the applicant the 
verbatim field reader cormnents has pointed out that the quiality of the 
remarks has improved noxr that the field reader is ax-jare that they are 
intended for* both the applicant and the USOE, 

Sending out field reader comments has had a miracu- 
lous effect on what the field reader says and how he 
says it. Occasionally a field reader xTOuld make some 
comment on the evalxxation form that the analysis pro- 
posed 'stinks,' I don't get this anymore. Instead, 

I get a reasoned e^lanation of x^hatever position the 
evaluator has taken. 

This comment leads directly to the third problem anticipated by 
some Directors of Educational Research, namely: that field reader 

comments can be too "harshly stated," Although this undoubtedly 



liappens i'rom ti.ae to time, the last quotation offers reassurance that 
field readers are more compassionate if they Icnox-r their comuents are 
going to be read by the applicant. 

It is possible, that upon occasion field readers xionld prefer to 
address some of their comments, liarsh or not, to USOE exclusively. 

Such an option could be provided by designing the evaluation form in 
such a tjay that a copy of the comments recorded belox-r a perforation 
covild be sent to the applicant and those above would be kept confi- 
dential,'^ 

To ejcplore the suitability of a perforated evaluation form for 
the review of proposals, x^re asked field readers whether they would 
recommend this change, A total of 36 per cent recommended the format 
not oiily for RRP proposals but for all USOE proposals,^ 

We asked the Directors of Educational Research to e^^press their 
views about tliis possibility* Three indicated they are "all for it"; 
txro are interested in testing it; one thinks it is preferable, but he 
would still be confronted x-rith the problem of ambiguity ir^ the com- 
ments made by sonie reviexrers; and another thinks it wuld increase 
"the bxirden placed on the reader as x-rell as not mask the style or 
handx-n’iting of the reviex-rer," Unfortxonately, this question x-jas not 
raised dxxring the interviex^s xiith the txro remaining Directors of Edu- 
cational Research, 

The foxxrth and last problem discussed by some Directors of Edu- 
cational Research is that of conflicting evaluations which xrould 
tend to confuse the applicant. But this problem, too, is manageable* 
Txro Directors have devised x^iays for coping xrLth it. One said: 

In the beginning I used to iron out the conflict if 
it existed I*d try to be the judge and go-betxreen. 

But I found that wasn't a good idea ,., In fact^ I 
tiave learned just the opposite, I have letters in my 
file commenting favorably on the fairness of sending 
out all the comments. 

The other remarked: 

If a guy had four disapprovals and one approval, 
those sxreet comments don't necessarily Ixave to go 

"^This type of evalxxation forra is used by Science , the official 
publication of the American Association for the Advancement of Science, 
for reviex-ring articles. See Bixlletin, American Associa-tion for the 
Advancement of Science (Iferch, I 969 ) and the "Instructions to Review- 
ers," prepared by the editors of Science , 

^Chapter Seven, Table 7,2, 



back. Rather +han *** falsely encourage the guy I 
just send him the comments of the others along uith 
the' letter that tells him he -wasn't funded. After 
all, he is still hearing from more than one reviex'jer. 

Each of these Directors has a different style, but both provide the 
applicant mth inforjTiation about the strengths and X’lealcnesses of his 
proposal. In effect, this feedback is a minimui'a return on the effort 
e>q^ended by the applicant. 

Finally, none ox the Directors of Educational Research who have 
sen'b verbatjjn field reader comments to applicants have found 'that 
they need to protect the "unsophisticated reseai’cher," As one Direc- 
tor said: 



Sometimes the criticisms are pretty rough, but the 
applicant can see where he went wrong and strengthen 
his proposal before he goes to anyone else for money. 
In the final analysis, is it kinder to turn dox-m an 
applicant xjithout letting him knoxv x-jhy? 



Summary 



In brief, this chapter has e::camined the applicant's experience 
submitting a proposal to the RRP, Some applicants are pleased x-Ji'bh 
the xjuy the regional offices processed their proposals, but many are 
not, 'Whether satisfied or not, their evalxoations emphasize the length 
of time from submission to notification of final disposition, and the 
explanation offered for the granting decision. 



Understaffing and budget freezes severely hamper the efficiency 
xjith xriiich regional offices can process proposals. These problems 
plagued FI «68, the year of this study, and continue to handicap the 
Program, 



Some difficulties applicants encounter can be attributed to 
under staffing and budget freezes, and others to the limi"ted contact 
they have had xjith regional offices. In particular, applicants com- 
plain about ohe quality of feedback x-rfien they are notified of the 
granting decision. After spending time preparing the proposal, they 
are given, as they put it, the "brush-off," 

An alternative way to explain -bhe granting decision to applicants 
is to transmit field reader comments directly to them. Both appli- 
cants and field readers favor such a policy. The vievjpoints of the 
Directors of Educational Research diverge somex:rhat on this topic, but 
they are xdlling to consiefer the possibility. Hopefully, the discus- 
sion of the subject in this chap'ber xdll begin to ansx^er -bheir ques- 
tions by providing information not previously available. More 
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aeiioially, ve hor-c :.mt the data presented uill be useful to the Pro- 
gr^‘s Directors" in determining ways to mprove the processing of pro- 
posals from submission to final disposition* 
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CHAPTER SIX 



EPTECTS OF THE RESEARCH 

In the proposal each applicant states the contribution he an- 
ticipates making to education and outlines his plan for dissemination 
and utilization of the results. This chapter examines the outcomes 
of the projects funded and some of the ways they have had an impact 
on education. 

These projects are all small-scale efforts and no one e:j^ects 
dramatic short-run effects for the researcher or for the field of 
education. As one Director of Educational Research remarked: 

I don't expect phenomenal impact out of RRP- sip- 
ported research. After all, the researchers only 
have at the longest eighteen months to do their 
work. 

To be sure, research that has "phenomenal impact" is hard t.o come by 
whatever the size or duration of the project, and as this Director 
added: "research that is less than phenomenal can be useful." "What 

the individuals administering the Regional Research Program (RRP) aim 
for is research that idl.1 be implemented, not research that "ends ip 
on the shelf." By implementation they mean dissemination and utili- 
zation of research findings; 

(1) in the classroom 

(2) in colleague exchanges 

(3) in work -iri-th individual students who then may 
do further research on education. 

(Il) through professional meetings, publications, 
and the preparation of in-service teaching 
materials. 

The Directors of Educational Research are also concerned about 
the impact of the research on the career of the researcher and his 
institution. One of the purposes of the Program is to strengthen 
research at developing institutions. Of concern is the researcher 
who gets funded, gains recogiition for the quality of his work and 
then is recruited by another institution. As a result, the Directors 
have to start re-building research resources at the institution idiich 
has lost the promising researcher. 

We have collected considerable data on the outcomes of the re- 
search in ordor to eoplore its impact on education and on the career 
of the researcher. At the time we surveyed researchers, nine out of 
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ten had recently TOitten their final reports or were completing the 
research undertaken with RRP funds. ^ Thus, these data rei^ect the 
short-run effects of the research. A follow-up study would be re- 
quired to uncover long-range effects of the research. 



Classroom Teaching 



RRP research is utilized in the college classroom. A total of 
81; per cent of the funded applicants report that they discuss their 
projects in class. Over forty per cent present project data as part 
of their discussion; while another forty pei‘ cent keep the discussion 
on a more general level (Table 6,1). 



TABLE 6.1 

SIX OUT OF SEVEN RESEARCHERS DISCUSS 
THEIR PROJECT IN CLASS 



Discussion of project in class 


Proportion of 
funded applicants 


Discussed together -vd-th data 


•k3 


Discussed, but no data presented 




Discussed both with and without 
presenting data 


.01 


Not discussed 


.1? 


TOTAL 


1.00 (221) 


Aim 

Cases excluded 


29 


NA = 


1 




25i 



"^Project ju^t begun. 



One might expect that funded applicants who have formal teaching 
responsibilities wuld be most likely to discuss their projects in 
class. However, as Table 6,2 shows, whether funded applicants did or 
did not have formal teaching reL-ponsibilitiet.:, they Trere equally 
likely to discuss their projects in a class — evidence that RRP 
researchers are classroom-oriented, 

^Appendix B, Table 6.1, 
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TAJ3LE 6.2 



RESEARCHERS VJITH OR WITHOUT TEACHING RESPONSIBILITIES 
DISCUSS THEIR PROJECTS IN CLASS 



Discussion of project in class 



Teaching responsibilities 
Yes No 



Discussed together with data 




.ho 




Discussed, but no data presented 


.10- 


.h3 




Not discussed 


.1^ 


.18 




TOTALS 


1.00 (179) 


1.01 


m 






N «= 


219 




Cases excluded’’^ 


29 






NA = 


3 








2$1 



%i*oject just begun. 



Even more interesting are the figures in Table 6.3* They show 
the relationship between the subdivision of a funded applicant and 
discussion of his project in class. 

Although most funded applicants xiri.thin and outside higher edu- 
cation discuss their research projects in class, those affiliated 
1 -ri.th a university research bureau are most likely to do so. In fact, 
every funded applicant at such a bu2‘eau engages in class discussion. 
The old clea^rage between teaching and research apparently does not 
describe RRP-supported research. 

Tables 6.1 to 6.3 should be encouraging to policy ma,kers of the 
RRP who are interested in the dissemination of research to the class- 
room, If any fear that the results of research facilitated by a uni- 
versity bureau are destined solely for professional journals and 
books, the data suggest their fears are groundless. Later in this 
chapter we x-rill esg^lore the publication intentions of funded appli- 
cants, but whatever they may be we already know that a major avenue 
for disseminating the results of research is classroom discussion. 

Besides discussion there are other ii?ays whereby research may 
enter the classroom. As a result of his work, a researcher may en- 
courage students to take specific courses in allied disciplines, he 
may re-organize a course that he has been teaching, or he may evolve 
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Project just begun 



an entirely new course. 

Table 6ak lists five kinds of curriculum changes recommended by 
researchers, once again taking into account whetbar they had teaching 
responsibilities while conducting their projects. 

The most likely recommendation of researchers, with or without 
teaching responsibilities, is shifting emphasis Klthin a particular 
course. As one would expect, researchers viith teaching responsibili- 
ties are more likely to re-organize a course (38 per cent) than 
researchers i-dthout such responsibilities (12 per cent). 

Of the curriculum modifications listed, researchers are least 
likely to suggest courses in allied disciplines to students. The data 
for explaining this finding are not available, but the Directors of 
Educational Research could suggest this type of cross-fertilization 
to applicants as another way to utilize the results of research. We 
know that researchers who change fields, namely, Ph.D.'s in a disci- 
pline who sTfdtch to education and Ed.D.'s who smtch to psychology are 
likely to be funded (Table 2.8). This suggests that communication 
among disciplines can be productive for education. 

Not all researchers are led to introduce instructional changes, 
as Table 6,k also shows. Note that (h3 per cent) of the researchers 
with teaching responsibilities and 20 (^1; per cent) of those without 
teaching responsibilities state that their research has not led them 
to a single course or curriculum change. 

We did some further analysis of these researchers. It turns out 
that 7^ per cent of those v:ho were students at least part-time when 
they completed the questionnaire recommend curriculum or course modi- 
fications, whereas only [).5 per cent of the non-student researchers do 
so (Table 6.5). In sum, RRP research tends to have a greater impact on 
the curriculum if the project has been conducted by a student — the indi- 
vidual currently striving to adhere to a ciu’riculum plan. 



Colleague Exchanges 

Collegial exchanges is a second way of imf)lementing RRP research. 
Typically, this exchange takes place in the seminar setting. To 
learn whether researchers discuss their research at faculty or student 
seminars, we asked them: 

Have you been invited to discuss this research with a 
facuilty or student group? 

(item #h9) 
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Proportions exceed 1.00 because funded applicants could name more 
than one change. 

'^^'^roject just begun. 



TABLE 6.^ 



RRP RESEARCH Ca^IPLETED BY STUDENTS IS MOST 
LIKELY TO RESULT IN CURRICULUM CHANGES 



Number of curriculum 
changes recommended 


Status of 
Student 


researcher 
Ndri- student 




One or more 


. 7 ^ 






None 


.2^ 






TOTALS 


1.00 (^7) 


1.00 (161) 








N = 


218 




Cases excluded"''^ 


29 






NA = 


_h 








2^1 



"Project just begun. 

The ansvjer options included: 

— Faculty seminar in my department 
— Interdepartmental faculty seminar 
— Faculty- student seminar in my department 
— Interdepartmental faculty-student seminar 
— Student society. 

The extent of seminar participation by RRP-funded researchers is showi 
in Table 6.6 below. RRP researchers are more likely to Ur invited to 
discuss their research i'ri.th members of their own department than with 
members of interdepartmental gro\:ps. Recall that Table 6.I4. highlights 
the small number of RRP researchers who suggest courses in aillied 
disciplines to students, and now we see that researchers are not 
likely to be invited to present their work at interdepartmental semi- 
nars. 



Individual Student Training 

As discussed earlier, a main goal of the RRP is resource building, 
that is, providing promising researchers vjith an opportunity to carry 
out small-scale research projects. Supporting research in institu- 
tions "VTithout much' of a tradition in research is assumed to have a 
"multiplier effect," as it were. An atmosphere of empirical inquiry 
will develop in the classroom; students tri-ll become more research- 
minded; and a few will be afforded the chance to become research 
assistants on projects. The e3q)erience of working on projects, it is 
hoped, x-jill propel some of the abler ones into educational research. 



TAJLE 6.6 



THE RRP-SUPPORTED RESEARCHER IS MOST FREQUENTLY INVITED TO 
DISCUSS HIS PROJECT VIETH A SEMINAR IH HIS OVJN DEPARTMENT 



Invited to discuss project ;jith: 


Teaching responsibilities 
Yes No 




Faculty seminar in own department 


.50 


.33 




Faculty- student seminar in own 
department 


.36 


.70 




Interdepartmental faculty seminar 


.26 


.17 




Int er depar tme ntal faculty- student 
seminar 


.18 


.17 




Student society meeting 


.lii 


.03 




TOTALS 


i.W^ 


(95) l.iiO-^ ( 30 ) 








N 


= 125 


Not invited to discuss project 
T-ri-th any of these groups 




( 80 ) (10) 


90 






Cases excluded'''"''^ 


29 






NA 










251 



'^^oportions exceed 1.00 because researchers could participate 
in more than one type of seminar. 



*^roject just begun. 



Ff-om the reports of RRP-supported researchers we know whether 
students assisted on their projects and whether these students became 
more interested in educational research. These results of being 
funded are examined next. 

In tiTO out of three RRP projects, students assist researchers.^ 
More important for the future of educational research are the results 
of Table 6.7. The researcher with teaching responsibilities who 
advises on doctoral dissertations is most likely to have students 
assist him in his research, A total of 81; per cent of these research- 
ers state that students work on their projects, whereas only ij.2 
per cent of those who neither teach nor advise on dissertations involve 



2 

Appendix B, Table 6,2. 
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students in their research* In effect, an RRP grant to a dissertation 
advisor vdio is, teaching is more likely to result in underwriting a 
student research assistant than a grant to a researcher i-jith neither 
of these responsibilities. 



TABLE 6*7 

TEACHERS I'JHO ADVISE ON DISSERTATIONS ARE MOST LIKELY 
TO HAVE STUDENT ASSISTANTS ON RRP PROJECTS 



Doctoral 

dissertation 

ad"visor 


Teacher 


Proportion with 
student assistants 


Number of 
researchers 


Yes 


Yes 


CO 

• 


(62) 


Yes 


No 


[5] 


(6) 


No 


Yes 


.68 


(113) 


No 


No 


*k2 


(33) 




TOTAL 


.69 


21ii 






Cases exclude 


29 






NA = 


8 








2^1 



Project just begun. 



Note ; Bracketed number refers to the actual number of 
funded applicants where there are too few cases for determining 
proportions. 



Still more important, four out of five funded researchers idio are 
both dissertations advisors and teachers report that students who as- 
sist them on RRP projects intend to do further work in research, an 
indication perhaps that ejqjerience on a project increases commitment 
to research (Table 6,8), 

Earlier in this chapter we saw that projects ccnciicted by students 
and by researchers at viniversity bureaus are particularly likely to 
have an in^sact at the classroom level (Tables 6,3 and 6,^), Now in 
Tables 6.7 and 6»8 we see that projects conducted by dissertation ad- 
visors provide students with research training "which, in turn, stiiriu- 
lates an interest in doing further T-:ork in research* In other words, 
the researcher’s s"tage of professional development, his position, and 
the nature of his institutional affiliation may influence the 



TABLE 6.8 



FOUR OUT OF FIVE DISSERTATION ADVISORS I'JHO ALSO TEACH 
EXPECT STUDENT ASSISTANTS TO DO MORE RESEARCH 



Doctoral 

dissertation 

advisor 


Teacher 


Proportion 
whose student 
assistants will 
do more research 


Number of 
researchers 


Yes 


Yes 


.79 


(52) 


Yes 


No 


Co] 


(5) 


No 


Yes 


.ill 


(76) 


No 


No 


.29 


(111) 




TOTAL 


.52 


lli7 




No 


student assistants 








on RRP project 


66 






Cases excluded’’^ 


29 






NA = 


9 








25i 



Project oust begun. 



Note ! Bracketed number refers to the actual nmber 
of funded applicants where there are too few cases for de- 
termining proportions. 



dissemination of his research findings. Given the interest of the 
RRP in supporting research that will contribute to a climate of re- 
search on the campus, these data suggest that the Program should con- 
tinue to support both student and non-student researchers. 

Disseminating the results of research beyond the campus is also 
of interest, Tvio active means are presenting a paper at a professional 
meeting and preparing a manuscript for publication. In addition, as 
a researcher’s work becomes known, he may be asked by a professional 
journal to evaluate an article on a related topic, or approached by 
a publisher about a book on his research, or invited by a funding 
agency to evaluate a proposal. The applicants were asked about each 
of these outcomes and their plans and e^gieriences are discussed here. 
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Professional Meetings and Publications 



Presenting a paper at a professional meeting is an early stage 
in the dissemination of research findings beyond the campus. A 
recent study of information exchange in educational research finds 
that a meeting presentation is typically the first public announce- 
ment, 3 

At the time of the survey, 6? per cent of the RP{P- supper ted re- 
searchers intended to present or had already presented papers at 
professional meetings,^ Most papers are presented at national meet- 
ings, although about l5 per cent are presented at state, regional, 
or international meetings of professional societies,^ 

Students using their projects for doctoral dissertations are 
less likely to present papers at professional meetings. As Table 
6,9 shows, ^8 per cent of the doctoral students report their research 
at professional meetings in contrast to 70 per cent of those who are 
not using project data for dissertations. 



TABLE 6,9 

RESEARCHERS NOT WRITING DISSERTATIONS ARE MORE LIKELY 
TO PRESENT PAPERS AT PROFESSIONAL PiEETINGS 



Present a paper at a 
professional meeting? 


RRP project 
Yes 


for dissertation 
No 




Yes 


,58 


.70 




No 


,U2 


.30 




TOTALS 


1.00 (59) 


1.00 ( 163 ) 

N = 


222 




Cases excluded"^ 


29 

25i 



'Project just begun. 



^'Pilliam D. Garvey, Carnot Nelson and Nan Lin, ”A Preliminary 
Description of Scientific Information Exchange in Educational Re- 
search” (Baltimore, Maryland; The Center for Research in Scientific 
Communication, The Johns Hopkins University, unpublished mimeo, 1968), 

p, 2, 

^Appendix B, Table 6,3® 

^Appendix B, Table 6,i|, 
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One might expect that findings about presentations at meetings 
would be parallel to that about publications. Though this is true 
in general, there are differences among RRP-supported researchers. 
Some attach greater priority to disseminating their research in 
wi’itten form. 



First, a higher proportion of researchers XTrite for publication. 
As noted above, o? per cent present a paper based on this RFIP re- 
search at a professional meeting whereas 72 per cent are writing or 
have written their research results for publication.® As a rule, 
researchers -write journal articles, although about ten per cent plan 
to -write a book or part of a book.' 



Second, not all researchers are equally likely to publish. The 
researcher x-jith a Ph.D. in a discipline is most likely to prepare a 
manuscript for publication; the Ed.D. is least likely (Table 6.I0). 



TABLE 6.10 

THE PH.D. IN A DISCIPLINE IS MOST LIKELY TO PUBLISH 
THE RESULTS OF HIS RRP-SUPPORTED RESEARCH 



Plan 


to publish 


rn , 

-ype 


of doctorate 




the results of 
this research? 


Ph.D. in a 
discipline 


Ph.D. in 
education 


Ed.D. 






Yes 


.7^ 


.70 


.68 






No 


.25 


0 

m 


.32 






TOTALS 


1.00 (65) 


1.00 (27) 


1.00 (38) 












N = 


130 








Cases 


excluded"^ 


121 












251 



^felP- supported researchers who did not have a doc- 
torate -when they applied for funds (N = 109), and re- 
searchers -with a doctorate whose project had just begun 

(N = 12). 



The Ph.D. in a discipline is expected bo be more research-minded while 
the Ed.D., more practice-minded. And the publication plans of the 

^Appendix B, Table 6.5. 

^Appendix B, Table 6.6. 



Ph.D, in a discipline and the Ed.D, recipients of RRP funds appear 
to suggest these different objectives. Whereas per cent of the 
PhiD.'s in a discipline intend to publish the results of their RRP 
research, this figure is 68 per cent for the Ed.D.'s. 

Moreover, the publication history of RRP recipients mth doc- 
torates parallels the pattern of the publication intentions just out- 
lined. As may be seen in Table 6.11, 92 per cent of the applicants 
with Ph.D.'s in a discipline have published at least one research 
study before applying for a RRP small-projects grant, then comes ap- 
plicants with Ph.D.'s in education, and only then the Ed.D.'s. 



TABLE '6.11 

AU'IOST EVERY PH.D. IN A DISCIELEffi HAS PUBLISHED 
A RESE.mCH STUDY BEFORE APPLYING FOR RRP :?UNDS 



Number of research 


Type 


of doctorate 




studies published 
prior to applying 
for RRP funds 


Ph.D. in a 
discipline 


Ph.D. in 
education 


Ed.D. 


One or more 


.92 


.85 


-79 


None 


,08 


.15 


.21 


TOTALS 


1.00 (i59) 


1.00 (81) 


1.00 (106) 








N = 3i;6 






Cases 


exc^.uded"^ 309 



NA = 10 

665 

%RP applicants who do not have a doctorate. 



Although students who intend their RRP projects for doctoral dis- 
sertations are less likely than non-students to present papers at pro- 
fessional meetings (Tabl.e 6.9)^ this does not mean that they do not 
publish the results of their research. As Table 6.12 shows, ?5 per 
cent of the students have publication plans for their research, a figure 
T'fhich surpasses 71 per cent for the non-student group. 

Finally, the publication plans of doctoral students xjho subse- 
quently received their degrees® are worth noting, even though they 

thirty-seven of the 65 doctoral students (57 per cent) reported 
that they received the doctorate after con?)leting the RRP project. 
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TABLE 6.12 



THREE OUT OF POUR DOCTORAL SF.'D.EMTS TO INTEND 
THEIR RRP PROJECT FOR A DISSERTATION /J50 PLAN 
TO PUBLISH THE RESULTS OF THEIR RESEARCH 



Plan to publish 
the results of 
this research? 


RRP project for a dissertation 




Yes 


No 


Yes 


.7^ 


.71 




No 


.25 


.29 






1.00 (59) 


1.00 (163) 








N = 


222 




Cases excluded 


29 








25i 



^Project just begun. 



represent only ^7 per cent of the funded doctoral students. For this 
group of researchers j a total of 85 per cent who earned an Ed.D, plan 
to publish the results of their RRP research (Table 6.13). Even the 
young Ph.D. in education xirill be more active in publishing than those 
holding Ph.D.'s in education granted before 1968 (79 per cent, Table 
6.13 to 70 per cent. Table 6.10, respectively). These data suggest 
that the younger generation of doctoraues have a greater interest than 
the older generation in disseminating the results of their research 
through publication. 



Invitations and Requests 

To learn she extent to xirhich the dissemination of research con- 
ducted by RRP researchers leads to various invitations and requests, 
we asked the following question: 

As a result of this research, have you received any 
of the folloT-ring requests or invitations? 

(item # 53 ) 



These options were listed: 

— Asked by a colleague to critically read a paper. 
— Asked by a joixrnal to evaluate an article on a 
related topic. 

— Asked by a joiirnal to review a book on a related 
topic. 
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nSLE 6.13 



RRP-SUPPCRTED DOCTORAL STUDENTS WHO EARN AN 
ED.D. ARE MOST LIKELY TO PL/uN TO PUBLISH 
THE RESULTS OF THEIR RESEARCH 



Plan to publish 


Type 


of doctorate earned 




the results of 
this research? 


Ed.D, 


Ph.D, in 
education 


■Ph.D, in a 
discipline 




Yes 


.8^ 


.79 


[ 3 ] 




No 


,15 


,21 


IS 




TOTALS 


1,00 (i3) 


1,00 (19) 


1 \ 

1 t 










N = 


37 






Cases 


excluded’’'^ 


211; 










2^1 



^on-students (l86) and students (28) idio did not re- 
port they had received their doctorate when they completed 
the questionnaire. 



Note ! Bracketed numbers refer to the actual number of 
fvinded applicants where there are too few cases for deter- 
mining percentages. 



— Approached by a publisher about witing a book on 
this subject, 

— Asked by a funding agency to evaluate a proposal 
in this or a related area of research, 

— Invited by a funding agency to submit a proposal 
for further research in the area. 

Table 6 , 114 . shows the proportion of funded applicants receiving each of 
these invitations and requests. 

Two out of five researchers, as a result of their RRP project, 
are "asked by a colleague to critically read a paper," This is the 
principal request. Very few researchers receive ary of the other 
requests. For example, only 11 per cent are "asked by a journal to 
evaluate an article on a related topic," and fewer still— 6 per cent 
—are asked by a journal to do a book review on a related topic, 
invitations such as these are probably forthcoming after a research- 
er's work becomes known and accordingly, a follow-up study would be 
required to uncover these effects. 
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TABLE 6.1U 

FEV7 RRP RESEARCHERS ARE ASICED TO TAKE ON 
ASSIGM'iENTS RELATED TO THEIR RESEARCH 



Requests or invitations 


Proportion 
of funded 
applicants 


Number 
of funded 
applicants 


1. Asked by a colleague to critically 




(206) 
NA = 16 

222’‘" 


read a paper 

2. Approached by a publisher about 


.38 


writing a book on a related topic 
3. Asked by a journal to evaluate an 


.1^ 


(206) 
NA 16 

222’^ 


article on a related topic 

li. Invited by a funding agency to 
submit a proposal for further 


.11 


(205) 
NA = 17 

222"'^ 


research 

Asked by a funding agency to 
evaluate a proposal in this or 


.07 


(205^ 
NA = 17 

222'^‘‘ 


a related area 


.06 


(205) 


6, Asked by a journal to review a 




m = 17 

222* 


book on a related topic 


.06 


(207) 
NA = l5 

222* 



' "''’Tr-renty-nine cases excluded because project just begun, 

i- 
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Career of the Researcher 



V/e conclude this chapter on the short-range effects of RRP re- 
search by discussing first, the funded applicant's interest in doing 
further research on education and second, his professional mobility. 
As we shall see, beiiig a recipient of RRP funds has considerable 
effect on interest in doing further research on education and little 
effect on mobility. 

¥e asked applicants; 

¥hat effect has this research experience had. on your 
interest in doing research on education? 

(Item #57) 

We then presented the folloxn.ng answer options: 

— It has strengthened my interest in doing research 
on education . 

— It has not appreciably affected my interest. 

— It has diminished my interest in doing research 
on education. 



Seven oat of ten funded applicants report that their interest in 
doing research on education has been strengthened as a result of 
their RRP project. Only three per cent indicate their RRP experience 
diminished their interest in research on education.” 



As Table 6.l5 shows, the funded applicants who are most likely 
to state that their interest in research on education has been 
strengthened, are the students who undertake projects for their doc- 
toral dissertations. A total of 8l per cent indicate that their 
interest in the field has increased. This finding does not detract 
from the 68 per cent of the non-students experiencing greater inter- 
est. Resource building, that is recruiting researchers to the field 
of education is the focal point of the RRP, and every Director of 
Educational Research seeks to find such people. V/ithout a doubt, 
their work has been productive, as Table 6,l5 shows. 

As a group, funded applicants do. not change institutional af- 
filiations. Three out of four have remained at the same institu- 
tion.^*^ 



Of the funded applicants, only those vdio intend their projects 
for dissertations are more likely to have moved. As may be seen in 
Table 6.16, 5? per cent re-located, in contrast to lii per cent of the 
remaining funded applicants. 

^Appendix B, Table 6.7. 

^^Appendix B, Table 6.8. 
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TABLE 6.15 



FOUR OUT OF FIVE DOCTORAL STUDENTS REPORT 
THAT THEIR INTEREST IN RESEARCH ON 
EDUCATION HAS BEEN STRENGTHENED 
AS A RESULT OF THEIR PROJECTS 



Effect of funding on 
research interest 


RRP project for 


a dissertation 




Yes 


No 




Strengthened interest in 
doing research on 
education 


.81 


.68 




No appreciable effect 


.lU 


.30 




Diminished interest 


.05 


.02 




TOTALS 


1.00 (6U) 


1.00 (18U) 








■N = 


2l|8 






NA = 


3 

251 



TABLE 6.16 



ONLY RRP-SUPPORTED DOCTORAL STUDENTS 
CHilNGE BfSTITUTIONAL AFFILIATION 
AFTER ST^IRTBIG THEIR PlESEARCH 



Institutional 

affiliation 


RRP project for a dissertation 




Yes 


No 


Different 


.57 


,lh 




Same 




.86 




TOTALS 


1.00 (56). 


1.00 (176) 








N = 


232 




NA or not employed = 


19 








25l 




io5 




9 



The fact that more than one iialf of the doctoral students re- 
locate is not paj'ticularly surprising. From the perspective of the 
RRP the important point is that they develop a keen interest in re- 
search on education, which they carr''’’ to their nexj location. 



Summary 

This chapter has examined the results of RRP-supported research 
as they affect classroom teaching, colleague exchanges, training of 
individual students, publication plans, and the career of researchers. 
The data show that almost every researcher discusses his project in 
the classroom, about half participate in departmental seminars, and 
dissertation advisors ^dio also have teaching responsibilities offer 
students the opportunity to work on their projects. In addition, most 
researchers plan to publish a manuscript based on their RRP research. 

The students who are funded and intend using their RRP projects 
for dissertations are particularly interest Img. As a result of their 
RRP research, they are more likely than non-students to recommend 
course or curriculimi changes, to plan publishing the results of the 
research, and to have developed a strong interest in research on edu- 
cation. 
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CHAPTER SEVEN 



APPRAISAL OF THE PRCGR/HI 

This chapter provides an appraisal of the USOE Regional Research 
I^ogram (RRP) by all respondents. It covers the p.’"ocess of review^- 
the ceiling on grants, and the image of the Program* 



The Review Process 

Chapter 5 examined the review process from the perspective of ap- 
plicant for small project grants. Wow we vjant to consider the review 
process from the perspective of two other key participants, the field 
readers and the Directors of the Program. In particular, we vd.ll dis- 
cuss their viev-jpoints of the two systems for revievd.ng proposals (by 
panel or by correspondence), and of the USOE Field Reader Evaluation 
Form, ¥e vdll also report what field readers see as the advantages of 
being a reviewer and their comments about the Program, 



As may be recalled, we surveyed field readers who had reviewed 
at least one proposal for the RRP in FI *68, In this discussion of the 
field reader data, hox^ever, we are not only interested in their ex- 
periences in FI '68, but in their cumulative experiences. And, most 
field readers vjho served in FI ’68 liave continued with the Program, 82 
per cent to be precise,^ 



All but two of the ^ield readers surveyed have reviewed RRP pro- 
posals by correspondence'" and 27 pen cent have also reviewed them at a 

panel session, 3 ¥e asked field readers to evaluate these txjo systems 
for reviewing proposals by answering the following question: 



On balance, x^hich system of review do you think 
yields better ex/aluations of Regional Research Pro- 
gram proposals: (a) proposals reviewed at a panel 

session? (b) those reviewed by correspondence? 

( Item #19 ) 



A total of 33 per cent said they prefer the panel system, 7 per cent 
review by correspondence, and 60 per cent said they could not compare 
the tx-Jo»4 



^Appendix B, 
^Appendix B, 
3 Appendix: B, 
^Appendix B, 



Table 7*1. 
Table 7*2, 
Table 7.3. 
Table 7.14-. 
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Cross -tabula ting the field reader's experience mth his appraisal 
of the too systems of review produced the results presented in Table 

7 . 1 . 



TABLE 7.1 

THREE OUT OF FOUR FIELD R.EADiiRS mO HAVE 
REVIEl'ED RRP RROPOSALG AT A PANEL 
SESSION PREx'^ THE PAI'JEL SYSTEM 





Experience 




Preferred system for 
revievdng proposals 


Reviewed proposals 
by correspondence 
and by panel 


Reviewed proposals 
by correspondence 
only 




At a panel session 


.76 


.17 




By correspondence only 


.09 


,06 




Cannot conpare the two 
systems 


.1^ 


.77 




TOTALS 


1,00 (111) 


1.00 (286) 








N = 


397 






NA = 


26 








Z23 



As may be seen in the table, 76 per cent of the field readers xfho have 
participated in panel sessions prefer this system of review. By and 
large, field readers who have been only individual reviewers report 
they cannot compare the tx-ro systems. 

Some field readers jotted notes in the margins of their question- 
naires e^g^laining their preferences. A few esamples are cited, 

I feel strongly that the panel process gives the pro- 
posal witer a better evaluation of his document than 
a review just by mail. 

The panel affords an opportunity to thrash out differ- 
ences in revievrer evaluations, 

I have found the panels stimulating and mthout a 
doubt, the best in-service education I experience, 

108 
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Not every field reader favora the pa:iel* Two who prei’er to review 
by mail said: 

Reviewing by mil, aie must get dow to business. I 
have found that some penel members don't "do their 
homeTrork," and the others have to do all the x-rork* 

I can spend more time revietdng a single proposal by 
mail than reviewing a batch of proposals for a panel 
session. 

Of the nine Directors of Educational Research, eight \-jere asked 
their opinions of the two review systems. All of the eight Directors 
rated the panel as the better method. Their reasons are perhaps best 
stated in their c ;n xrords. One Director said: 

First and foremost, the panel provides an opportxonity 
for the opinions of several individixals to converge 
on a pcirticxxlar topic. One of these may point up some- 
thing all the others have not seen. And, itfs an inter- ■ 
disciplinary effort and profits from the give-and-take 
that goes on in the ccurse of arriving at a decision. 

Another added: 

The ixanel is the best xjay to keep subjectivity to a 
minimxom. Some of these reviewers really get emotion- 
ally involved and the others bring ’''iin back in line. 

A third summed up his preference by saying: 

The panel i.s the superior system. The proposals get 
reviex'jed three times: (l) by the readers at home; 

(2) here as they are discussed; and (3) as they think 
them over in reaching consensus. 

In addition, tx-ro Directors of Educational Research think it is a 
good id-a for observers to attend panel sessions. They reason that 
the panel then becomes an additional res ox.irce-buil ding tool in their 
regions. One described his recent experience in these xrords: 

I got in touch with the directors of regional training 
programs in my region and invited oach of them to send 
one of their research trainees at their ox-m expense to 
a panel meeting, The directors agreed enthusiastically., 

I then sent a copy of every proposal that was to be 
considered at the panel to the research trainees, and 
asked them to read the proposals before coming to the 
session, I also told them they could comment on the 
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proposals at the panel session, but they vjere not to 
dominate the discussion, 

I then insisted on their [invited guests] taking one 
responsibility; they were to report their e^qaeri- 
ences at the panel, mthout identif’ang any individu- 
al when they got back to their collage. I must say 
I got very good reports on this. 



Field Reader Evaluation Form 

Both field readers and the Directors of Educational Research com- 
mented on the suitability of the Field Reader Evaluation Form for re- 
viewing ijroposals submitted to the RRP, As we sliall see, some recom- 
mend changes. Table 7.2 lists six changes in the fom that field 
readers considered, and shows the proportion idio recommend each one. 

We T'jill discuss each change, adding the viei'jpoints of the Directors of 
Educational Research tdierever available. Since the questionnaire to 
field readers was developed after interviei*7ing the Directors of Edu- 
cational Research, ice do not have their opinions on every change con- 
sidered by field readers. 



Six Proposed Changes 



(1) A total of 69 per cent of the field readers recommend that 

the criterion ’’adequacy of personnel and facilities” be separated into 
two parts: ’’adequacy of personnel" and "adequacy of facilities," 

They reason that these are in fact two distinct qualities which they 
would prefer not to evaluate jointly. For example, they may question 
the researcher’s ability to carry out the project, but not the organi- 
zational facilities available to him. They vrould like the form to 
provide separate sections for such a ccntingency, 

( 2 ) The second change most field readers would lilce to have 
initiated is a rating scale for each criterion. After evaluating, 
say, the educational significance of a proposal, the field reader 
would then rate this criterion on a scale graded from 0 uo 10, He 
would folloi'r a similar procedure for the other criteria. One Director 
of Educational Research favors quantifying evaluations of a proposal 
in this way. The other Directors expressed no preference, 

( 3 ) The recommendations 

Perforate the form so that [field reader] comriients 
recorded below a perforation could be sent to the ap- 
plicant, while those above would be for USOE exclu- 
sively 

was considered in Chapter 5 as one way the field reader comments could 
be transmitted directly to the applicant. As may be recalled. 



mBLE 7.2 



CHANGES IN THE USOE EVALUATION FORM 
RECOM'IENDED BY FIELD READERS 



Proportion of 

Suggested changes field readers 

recoininending change 

Separate the criterion "adeqaacy of 
personnel and facilities" into tw) 
criteria, "adequacy of personnel" 

and "adequacy of facilities" .69 

Provide a rating scale for each of 

the four criteria .62 

Perforate the form so that comments 
recorded below a perfcaration could 
be sent to the applicant, xdiile 
those above would be for USOE 

exclusively ,36 

Eliminate page 2 which asks the re- 
viewer to discuss the proposal as 
it relates to his area of speci- 
alization #33 

Standardize the form br^'" using check- 
lists instead of essay-type 

answers ,29 

Eliminate the criterion; 

(1) economic efficiency ,13 

(2) adequacy of personnel and facilities ,03 

( 3 ) educational sigiificance ,03 

(b.) soundness of research design ,01 

TOTAL 2,h9'''" (33i[) 

No changes recornriiended 89 

h23 



“Troportion exceeds 1,00 because each lield reader could 
recommend more than one change in the evaluation form. 
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apolicants, field readers, and several Directors of Educational Re- 
search favor sending a copy of the field reader comments to the appli- 
cant. 



(li) One-tliird of the field readers think that page 2 of the 
evaluation form, which asks the revievjer to discuss the proposal as it 
relates to ha.s area of specaalization, should be elira^jaated, ^ Three 
Directors of Educational Research also are of this opinion. As one 
said: 



I* d cut out that second page, life already know the 
field reader is qualified before we send liirti any pro- 
posals to read, 

(^) VJhether to standardise the form by using check-lists instead 
of essay- type answers evoked the most comraent from the Directors of 
Educational Research, Two completely opposed the j.dea, T]ie first ex- 
plained his opposition in these words: 

I woiildn't ;jant a check-list ,,. concepts like "educa- 
tional significance" defy a pat definition We 
shouldn't furnish them [field readers] xd.th the lan- 
guage necessary to make the evaluation, 

Tlie second remarked: 

The field reader picks cut what he considers the 
most salient aspects [of the proposal] deserving 
comment. This is one way to evaluate his [field 
reader’s] perforiiiance. You'd miss this opportunity 
I'd-th any kind of check-list, and there may be a ten- 
dency to just check xri.thoi\t adequate thought. 

Four Directors are Interested in ejqDloring the feasibility of de- 
veloping some form of check-list, but not one of these favors only 
check-lists. Each wants space for essay- type responses, as do eighteen 
field readers who jotted comments in the margins of their question- 
naires next to the item. 

The criterion, soundness of research design, would be in the view 
of one Director, the best criterion for check -lists. For example, a 
check-list might specify the group to be studied, the sample size, the 
research methods, and the plaruied modes of analysis. The field reader 
would rate the. extent to which these items were spelled out in the pro- 
posed research, 

d 

We recently learned from one Director of Educational Research 
that f '.eld readers are no longer asked to complete this page. 
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(6) 3y and la ’ge, field re.ader5 uould retain the four criteria 
nou used to evaluate p'. oposals. The’ diily ''criterion some question is 
economic efficiency: 13 per cent would eli:'iinate it. Tiiis is ailso 

the only criterion questioned by the Directors of Educational Research. 
Two think i>-. does not belong on the form. In their view, it is not 
within the province of field re£iders, but of the project officer, vi^o 
reviews the budget after a proposal is approved for finding. They 
point out that the local contribution, or cost sliaring, is negotiated 
later, if the proposal is approved for funding. 

Two others look at the criterion economic efficiency from another 
perspective,, One said: 

Economic efficiency is an impcrtant factor ... [field] 
readers can generally tell whether an applicant is try- 
ing to do too much for tco little or not enougli for too 
much. 

The other expressed essentially the same opinion but added that the 
"good" field reader suggests budget alternatives when he disagrees with 
what the applicant proposes. If computer time in a proposal is under- 
estimated, for erample, lie should offer a more realistic estimate* In 
other words, these Directors of Educational Research want the field 
reader to review the specific buolget entries. 

Finally, some field readers” recemnend adding other criteria to 
the fear now used to evaluate proposals. In particular, they would 
approve including the follovriaig criteria: 

— significance beyond educaoion 
~ creativity of the researcher 

— suitability [of the proposed research] for repli- 
cation. 

These criteria seem suggestive enough to vjarrant further thinking. 
To be applicable, however, they would have to be defined and this is a 
difficult task. For example, the criterion "significance beyond educa- 
tion" is defined by one respondent as "overalJ tlieoretical and scien- 
tific significance," To another, it means "iimnediate societal useful- 
ness." Obviously, both respondents have differen idsas about the 
definition of this criterion and neither definition satisfactorily ex- 
plains it, Horeover, adding a criterion as sweeping as ‘'significance 
beyond education" seoves to place unrealistic expectations .n a small- 
scale project to be completed xd-thin a maximum of eighteen months. We 
did, hovjever, xK,nt to mention this suggested criterion along with the 
other txjo for the Directors of tht. Program to take into account should 
they revise the Field Reader Evaluation Fcrm, 

^Appendix B, Table 7.5* 
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Advantages and Disadvantaojes of Bein^ 
a RRP Field Reader 



Field readers assessed their eijq^erience with the RRP in two ways. 
First, they checked a list of advantages which might be associated mth 
being s field reader; and second, they gave their reactions to the 
overall Program. 

To learn something of the motivation of field readers, we included 
the folloiring item in the questionnaire: 



— Acquisition of ’intelligence' about USOE 
granting practices 

— Contact vjith educational researchers from other 
institutions 

— Contact t-ri.th USOE officials 

-- S::<posure to new research ideas 

— Intellectual stimulation 

— Opportunity to contribute ideas to young 
researchers 

— Opnortmity to influence research on education 

— Professional prestige. 



The responses are summarized in Table 7*3 ^eloxj. 

As may be seen in the table, field readers value most the iiitel- 
lectual ejcperience of reviexiiing proposai.s. A total of 79 per cent 
checked "exposure to new research idea.s"; next, 68 per cent checked 
"intellectioal stimulation." 2h contrast, only 23 per cent see "pro- 
fessional prestig'e" as a rexjard from baing a field readei'. 

At the very end of the questionnaire space X'jas provided for field 
readers to comment on any aspect of the Program they x\7ished. Thirty 
per cent of the field readers e:if)ressed their views, and the comments 
are summarized in Table 7.U* 

Pour out of ten field readers who volunteered comments about the 
RRP consider it to he basically sound. Many field readers are enthusi- 
astic about the Program, and the foUoxdng excerpts from their remarks 
illustrate this point of viexr. 



Listed below are some possible advantages of being a 
field reader for the Regional Research Program. In- 
dicate those that ^ply to you personally. 



(Item #39) 



The eight answer options x^rere : 



I Ixave a strong positive bias toX'jard the RRP. It is 
closer to its clients than the central agency and the 
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TABLE 7.3 



FIELD READERS VALUE MOST THE EXPOSURE TO 
IDEAS THAT RESULTS FROM IUj]VIE\JING RRP 



MEVJ RESEi\RCH 
PROPOSAIS 



Proportion of field 

Advantages of being a field reader readers v;ho say advantage 

applies to them 



1. 


Esqposure to neu research ideas 


.79 




2. 


Intellectual stimulation 


.68 




3. 


Opportunity to inlluence research on 
education 


.61 






Acquisition of 'intelligence* about 
USOE granting policies 


.U6 




5. 


Opportunity to contribute ideas to 
yomg researchers 


,h2 




6. 


Contact vri-th educational researchers 
from other institutions 


• h2 




7. 


Contact with USOE officials 


.3? 




8c 


Professional prestige 


• 23 




9. 


Other (e.g., opportunity to perform 
a public service) 


,06 






TOTAi'. 


U.02* 








N = 


393 




Perceives no profess 


lonal advantage 


7 






NA = 


23 








U23 



%’roportion exceeds 1.00 because field readers could name moi’e 
than one advantage. 



people that I knoX'T feel it is much more open and ac~ 
cessible. 

The RRP is effective .... It encourages some reason- 
ably good and a few excellent research projecti .. All 
in. all, a good batting average, 

I strongly support the RRP, In ccsnnarison mth re- 
search programs in or out of education, large or 



TA.BLE 7.U 



POUR OUT OF TEN FIELD RMDMS COIL'IENTING 
ON THE RRP SEE IT AS A SOUND PROGRAM 



Volunteered comments about the RRP 


Proportion of field 
readers who made 
each comment 


Po s itive c omment : 






Program is basically sound 


.39 




Negative comments: 






Remuneration is inadequate for field 
readers 


.21 




Program is poorly adiainistered 


.10 




Recommendations : 






Contact betxoeen field readers and 
regional office should be iiiproved 


.20 




Practical imolications of research 
shoiiLd be emphasized more 


.15 




Funds for the Program should be in- 
creased 


.13 




Promising young researchers should 
get more support 


.10 






1 . 28 ^^ 






N = 


128 


Too little knot-rledge of 
Program to comment 


2h 




NA = 


CM 






k23 



■^^Prcportion exceeds 1.00 because some f:'.e‘'.d readers com- 
mented on more than one aspect of the Program. 



small, it is good. Some fine nork has been done in 
projects that cost a pittance. 

The small grant program in my estimation has n»en 
most successful in stimulating a vnde range of 
research in a variety of settings. I -would count it 
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the most ’productive and the highest cost/benefit 
ratio of all USOS programs. 

Apart from general reaction to the Program, Table also shows 
that one in five field readers criticize the remuneration they receive. 
In particular, they criticize the low remuneration and the excessive 
length of time it takes to receive it. With respect to the modest 
amount recoi''''ed for evaluating proposals, one field reader said: 

The remuneration is so low that it hardly warrants 
the ej^onse of processing, plus it demeans the 
value of the service in the eyes of those performing 
it. The fee should be raised or eliminated and, if 
the latter, some other means of recognition for the 
service should be considered. 

Another remarked; 

I think field re-'ders should be paid more. It is 
difficult and tirae consuming work, I enjoy it but 
my time needs to be compensated or other ventures 
encroach. 

In addition, some field readers complairi about the long interval be- 
tween review of a proposal and payment. As one phrased it: 

Remuneration, is scandalously slow, I liave not been 
paid for proposals I evaluated seven or eight months 
ago, 

Ti-renty-four field readers said they had so little knowledge of 
the Program that they could not comment on it. Others offered recom- 
mendations for inproving the Programj the major one being better com- 
munication betvjeen field readers and the Program, The need is conveyed 

by theSi. statements from field readers who feel out’ of touch with the 
7 

Program: ' 



One of the RRP's limitations is that field readers 
have never really been oriented. 

Another remarked: 

The evaluation of a proposal meets a dead end of 
silence. It is soraei^at frustrating to review a 
proposal and then have no clue as to the consequence 
of my comments, helpful or othert'dse. For that 
matter, I am not even told T-riiether the proposal gets 
funded. 



7 • • 

• With the increasing use of panels, such a sense of isolation xs 
likely to be reduced. 
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Improved’ communication can take several forms. For some of the 
field readers, it is feedback. One expressed it this "way: 

There should be more feedback to reviewers, I mean 
about tdiat happens to the proposals I evaluate ... At 
present I -t-rork in isolation, reacting to proposals on 
an absolute basis v^ith virtually no knowledge of the 
Program's goals. 

The theme of Program goals and fate of proposals vras voiced over and 
over again. Another idea comes from a field reader -who suggests that 
it vjoi’.ld be helpful to arrange for field readers to meet as a group 
T-ri.th the Directors of the Program at the AERA (American Educational 
Research Association) annual convention. Field readers would then have 
an opport’unity to ask questions about the Program and to keep abreast 
of its development. 

Finally, 1-5 per cent of the field readers urge that the RRP be 
better financed and even expanded, A few of thoir comments are ex- 
cerpted here. 

The RRP should be more soundly financed. It puis 
the DER's [Directors of Educational Research] in a 
damned embarrassing position when they must drum up 
proposals and have good proposals rejected because 
of inadequate funds. 

Uncertainty over the availability of funds has 
served to delay the review of proposals, 

I hope the USOE i-7ill put more of its resources in 
the RRP, It should be eD^)anded* 



The Present Ceiling 

At present, the ceiling for funding an RRP project is $10,000, 
Because of rising costs end overhead, some Directors of Educational Re- 
search question the adequacy of the present ceiling. Therefore, we 
asked applicants, field readers, and Directors what tlie ceiling should 
be. 



Table below shows wliat applicants and field readers recommend 
as the ceiling for small-project research, A large proportion would 
retain the $10,000 ceiling (UI|. per cent of the not funded; 30 per cent 
of the funded; and i^O per cent of the field readers). A small propor- 
tion vrould lower it (7 per cent of the not furided; 1 per cent of the 
funded; and 2 per cent of ’bhe field readers). But as the figures in 
Table 7,^ show, a considerable proportion of applicants and field 
readers recommend a highrjr ceiling. 

Opinions among the three groups differ. The not funded applicants 
are the most conservative and less likely than funded applicants to 
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TABLE 7.5 



A COHSID'SRABLS PROPORTION OF APPLICANTS AND 
FIELD READERS THHK THE $10,000 CEILING FOR 
Si'-IALL-PROJSCT RESE/iRCH .SHOULD HE RAISED 



Cumulative proportior 



Recommended 

ceiling 


Applicants 


Field 




Not funded 


Funded 


readers 


$2,000 


.01 


.00 


.00 


3,000 


.02 


.00 


.00 


^,000 


.06 


.01 


.01 


7,000 


.07 


.01 


.01 


7,500 


.07 


.02 


.01 


8,000 


.07 


.02 


.02 


10,000 


.5l 


.31 


.U2 


12,000 


.53 


.39 


.ilil 


12,^00 


.55 


.lj.O 


.U5 


13,500 


.55 




.U5 


i5,ooo 


.72 


.71 


.60 


17,500 


.7U 


.75 


.60 


20,000 


.89 


.91 


.78 


22,500 


.89 


.92 


.78 


25,000 


.98 


•97 


.96 


30,000 


.99 


.97 


.97 


^0,000 


1.00 


1.00 


1.00 


TOTALS 


(3U.U) 


(23U) 


(3U7) 


No ceiling 
recomraended 


1 


1 


7 


NA = 


69 


16 


69 




iilU 


251 


U23 


MEDIANS 


$10,000 


$iU, 000 


$iU,oco 
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rocorrii.icnd a ’ligher cejJLing, Forty-nine per cent of the not funded 
woLild r^ise the coiling; 69 per cent of the funded recommend raising 
it; and per cent of the field readers v;ould raise it. The funded 
applicants are confronted x-jith the reality of their budgets: more 

than per cent think that the ceiling should be ^j;i5_,000 or higher 
and 25 per cent think it shoxold be .)^20,000 or higher. 

Essentially tiiree reasons are given for higher ceilings: 

(1) It x/'Ould cover inflationary increases in pro- 
ject costs; 

(2) It xjould permit greater flexibility in research 
design; 

(3) It xjould provide higher salaries for research 
and clerical staff and permit acquisition of 
necessary equipment. 

Those X'jho regard the present ceiling as adequate also told us xjhy 
they hold this opinion, A fexr of their comments fellow: 

$10,000 is enough to ’get off the ground* ' 

The amount [$10,000] is about right to promote 
quickly realized objectives. 

Keeping the ceiling Iqx-r tends to discoxurage 
' grantsmanship. ’ 

A fex7 funded applicants noted that the $10,000 ceiling x-xould be 
adequate x/ere it not for the big overhead bite, Tx-ro described their 
experience in this x-7ay. The first remarked; 

The $10,000 limit is reasonable, if I could use it 
all for research, but the overhead requirements of 
my institution reduce tiie figure too much. 

And the second: 

$10,000 txirned out to be too small to fit every- 
thing in after the xmiversity got its 20 per 
cent overhead. 

The Directors of Educational Research also commented on the pres- 
ent ceiling. One favors the present ceiling, sximmarizing his viexjpoint 
in these x-jords : 

The ceiling doesn’t seem to interfere x-:ith the prod- 
uct, Some fine research has been done for less than 
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^ilOjOOO. I don't know that I could buy any hii^her 
qualitj'' research with more money. 

Another thinks the present ceiling is appropriate, but is bothered by 
the indirect costs. In essence, ho thinks the base for xuiids should 
be .1pl0,00C plus indirect costs. 

The remaining Directors who discussed the present coiling favor 
raising it, but not giving the maximum to every funded applicant. To 
be specific, they favor a lower ceiling for the doctoral candidate. 

The amount they suggest ranges from a low of ^jll4.,000 to a limit of 
$10,000. Although the Directors differ on the exact ceiling for sup- 
porting a doctoral candidatej their reasoning is essentially 'the same. 
They >mt tlie funds to cover needed facilities, possibly a modest 
remuneration for the sponsor, and a stipend between $3^000 and $5,000 
for the doctoral candidate himself. 

These Directors of Educational Research want the ceiling raised 
for other applicants. One said: 

1 think an established researcher (one who has a 
reputation for good work)' ought not to be limited 
to $10,000. Depending on the project he proposes, 
he ought to be eligible for $30,000, $14.0,000, maybe 
even $50,000, 

Another summarised his point of view in these words : 

I*d like to see the ceiling raised along vjith the 
unsolicited natxire of the program preserved. 

$50,000 or under is my preference and the exact 
amount should be worked out in the regional office 
vjith the applicant. 

And, finally, one Director thinks no ceiling should be iiiposed. 

The ceiling is completely uncalled for. ¥e should 
handle all unsolicited proposals, for $1,000 or 
$100,000. 



Overall Image of the RRP 

Applicants, field readers, and the nine Directors of Educational 
Research gave us their impressions of the RRP by answering four ques- 
tions about the Program's interests or procedures. These questions 
wall be discussed separately so that the Directors can learn the 
opinions of those having contact with the Program, 
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The first question read: 



Through a variety of sources, researchers get an 
overall irapression of funding agencies. Is it your 
current impression that the Regional Research Program 
is limited to a feu areas of special interest, or does 
it cover a broad range of interests in education? 

Three answer options were provided: 

— A few areas of special interest 
— A broad range of interests 
— I have no impression 

Table 7*6 below shows the proportion of applicants, field readers, 
and Directors -viio checlced each of the answer-options. 



TABLE) 7.6 

T170 OUT OF Fr/E APPLICANTS AND PTELD READERS LACK A 
CLEAR mOE OF THE RESEARCH lOTERESTS OF THE RRP 



Image of RRP 
research 
interests 


Funded 

applicants 


Propertion 

Not funded Field 

applicants readers 


Directors of 
Educational 
Research 


Broad range of 
interests 


.57 


.18 


.03 


[9f 


Few areas of 

special 

interest 


.09 


oo 


.17 


[0] 


No impression 


.31; 


.10; 


.00 


[0] 


TOTALS 


1.00 (2lj.8) 


1.00 ( 009 ) 


1.00 (013) 


9 


NA = 


3 


5 


10 


0 




251 


Oil; 


023 


9 


"^he number 


of DER*s who 


gave each response appears 


! in brackets. 



Every Director stated that the RRP has a "broad range of inter- 
ests," but only ‘?7 per cent of the funded applicants, ij.3 per cent of 
the field readers, and l8 per cent of the not funded applicants share 
this impression. The fact that only l8 per cent of the not fiinded 
applicants see the Program as having a "broad range of interests" is 



probably an unintended consequence of having their proposals turned 
doim. This study points up one aspect of research support which 
rarely is discussed: an agency’s image depends not only on how many 

researchers it funds, but also on hox'f many it turns doxm. 

The most interesting aspect of. Table 7*6 is the large nixmber of 
both applicants and field readers who have no impression about the 
research interests of the RRP* One out of three funded applicants 
have no impression and two out of five field readers also have no im- 
pression, These figures suggest that many participants in the Program 
have virtxxally no loioxvledge of the Program’s research interests. 

The second question asked about the image of the RRP vjas: 

Do you think the USOE Regional Research Program tends 
to be orthodox or venturesome in its support of 
research? 

The ansx^rer options were: 

— Orthodox; more likely to support established lines 
of research, 

— Venturesome; vTilling to take risks in developing 
nexj lines of research on education, 

— No opinion. 

Table 7.7 shows hov; the three groups of respondents ansxver this 
question. Eight out of nine Directors cteracterize the Program as 
vontviresome. The one Disrector who checked "orthodox," added: 

I would like to support more venturesome research, 
but I find that field readers are more likely to 
approve ’orthodox' research plans. 

Moreover, one-third of the applicants, x-jhether funded or not, and 39 
per cent of the field readers have no opinion regarding the tendency 
of the RRP to be orthodox or venturesome in its support of research. 
Here again, there is a sharp contrast betxijeen the funded and not funded 
applicants. Only $ per cent of those not funded view the Program as 
venturesome, but the number reaches Ijl per cent for the funded appli- 
cants. It would seem that being denied support has repercussions 
other tlian los-s of funds. 

Even fewer applicants and field readers loioxv whether the RRP is 
strict or lenient in permitting departures from the original proposal. 
This question v/as asked: 

As far as departures from the original proposal are 
concerned, is it your opinion that the Regional 
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MORE FUNDED APPLICANTS VIEW THE RRP AS VENTURESOME 
THAN EITHER FIELD READERS OR NOT FUNDED APPLICANTS 







Proportion 




RRP image 


Funded 

applicants 


Not funded 
applicants 


Field 

readers 


Directors of 
Educational 
Research 


Venture some 


.111 


.05 


.21 


[8]-^ 


Orthodox 


.25 


.63 


.ilO 


[1] 


No opinion 


• 3h 


.32 


.39 


[0] 


TOTALS 


1.00 (250) 


1.00 (U09) 


1.00 (Ia 2 ) 


9 


NA = 


1 


5 


11 


0 




251 


ItiU 


U23 


9 



^he momber of DER’s who gave each response appears in brackets. 



Research Program tends to be fairly strict or some- 
what permissive? 

Table 7.8 shows the proportion of respondents checking each of the 
answer options. Seven of the nine Directors are strict about expecting 
researchers to adhere to plans stated in their proposals, but appli- 
cants and field readers have a different ijnpression. Almost half of 
the funded applicants consider the RRP fairly permissive in alloxidng 
researchers to depart from their original plans. Note too the rela- 
tively high proportion of applicants and field readers xiio have no 
opinion about this policy. It is not surprising that so many not 
funded applicants (69 per cent) did not express opinions. Since their 
proposals did not become RRP projects, they lack the experience upon 
x-diich to base a judgment. In addition, 37 per cent of the funded ap- 
plicants and 58 per cent of the field readers are unsure about the Pro- 
gram's policy for handling departures from the proposal. This finding 
suggests, as well as those in Tables 7.6 and 7.7^ that many applicants 
and field readers have had too little exposure to the RRP* s policies 
to formulate opinions about its practices and interests. 

The fourth question regarding the image of the Program xvas; 

In comparing the procedures that an applicant must 
follow x;hen submitting a proposal to the Regional 
Research Program with those required by other 

12h 
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TABLE 7.8 



A MAJORITY OF THE DIRECTORS OF THE RRP ARE FAIRLY 
STRICT ABOUT ALLOV/THG DEPARTURES FROM PROPOSALS 



With respect to 
departures from 
proposals, the 
RRP is: 


Funded 

applicants 


Proportion 

Not funded Field 

applicants readers 


Directors of 
Educational 
Research 


Fairly strict 


.17 


.20 


.18 


[7]^^ 


Fairly permissive 


.U6 


.10 


.2h 


1 1 

C\J 
1 1 


No opinion 


.37 


.69 


.^8 


[0] 


TOTALS 


1.00 (2h9) 


.99 Oi07) 


1.00 (hl2) 


9 


NA = 


2 


7 


11 


0 




25l 


hlh. 


U23 


9 



■*^he niAmber of DIiR*s who gave each response appears in brackets. 



agencies', would you say the Regional Research Program 
involves more, about the same, or somewhat less "red 
tape"? 

An aim of the RRP, as stated in the Guidelines , is: 

... to provide for direct and e^editious handling of 
proposals. 8 

¥e can look to Table 7»9 to learn the success of the Program in achiev- 
ing this goal. Six of the nine Directors think the Program does well. 
They say the RRP requires less "red •tape" than other agencies. This 
opinion is not shared by applicants and field readers who are more 
likely to think of the RRP as requiring as much "red tape" as other 
agencies. The figures in Table 7 »9 reveal that 37 per cent of the 
funded applicants, 36 per cent of those not funded, and 37 per cent of 
the field readers hold this opinion. 

As discussed earlier in this report,^ applicants, field readers, 
and the Directors all have suggestions for speeding up the processing 
of proposals. If these suggestions are implemented, we would ej^Dect 

^Guidelines , op. cit ., p, 1 

^Chapter Five, 
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TABLE 7.9 



ONE OUT OF THREE APPLICANTS AND FIELD READERS 
SAY THE RRP REQUIRES THE S/\14E Al-IOUNT OF 
"RED TAPE" AS OTHER GRANTKG AGENCIES 







Proportion 




Impression of "red 
taue" in RRP 


Funded 

applicants 


Not funded 
applicants 


Field 

readers 


Directors of 
Educational 
Research 


More "red tape" 
than other 
agencies 


.12 


.23 


.10 


[0]^^ 


About the same 
amotint 


.37 


.36 


.37 


[ 3 ] 


Somewhat less 


.23 


.12 


.20 


[6] 


Mo opinion 


,28 


.29 


.32 


[ 0 ] 


TOTALS 


1.00 ( 2^0) 


1.00 (U08) 


.99 (Iil2) 


9 


NA » 


1 


6 


11 


0 




2^1 


lilh. 


i|23 


9 



^he number of DER’s vrho gave each response appears in brackets. 



a follow-up study of participants in the Program to show a higher prO' 
portion having the impression that the RRP requires "less *red tape’" 
than other agencies. 



Sumriiary 



This chapter has provided an overall appraisal of the USOE 
Regional Research Program from the perspective of applicants, field 
readers, and Directors of Educational Research. It has considered the 
review process, the present ceiling on individual grants, and the image 
of the Program’s research interests and policies. 

Both field readers and the Directors of the Program overwhelm- 
ingly favor the panel system for reviewing proposals. In addition, 
they recommend some changes in the present Field Reader Evaluation 
Form. In particular, a majority of the field readers would separate 
the criterion "adequacy of personnel and facilities" into two criteria, 
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"adequacy of perisonnel" and "adequacy of facilities." An equally large 
number think a rating scale should be provided for each criterion. In 
general, field readers value the e:^osure to nev; research ideas that 
is an inherent aspect of evaluating RRP proposals j and additionally, 
they value the intellectual stimulation of the experience. But they 
are critical of the Program too. They are disturbed about the limited 
contact they have vd-th the regional offices and the remuneration they 
receive. 

Most appliaints, field readers, and Directors agree that the 
present ceiling of $7 0,000 per grant should be raised. Applicants and 
field readers favor ceiling closer to $l5,000. The Directors have 
different points of view on the issue. One advocates retaining the 
present ceiling; another thinks there should be none; while several 
others favor raising the ceiling, but with a provision for varying 
levels of support. They think it is generally appropriate to support 
established researchers at a higher level than doctoral candidates for 
comparable projects. 

Only the Directors have a clear image of the RRP*s research poli- 
cies, At least one-third of the applicants and field readers do not 
know whether the Program supports a broad or narrow range of interests 
in education, or vdiether the Program tends to be orthodox or venture- 
some in its support of research. These findings suggest that the 
Directors should not delay implementing the recommendations for better 
communication between the participants on the outside and the Directors 
in the regional offices, if the Program is to build a uniform identity. 



CHAPTER EIGHT 



CCX'ICLUSIONS AND RECCM'fflNDATIOHS 



The preceding chapters liave e^camined data on the experiences and 
opinions of key participants in the USOE Regional Research Program 
(RRP). Those chapters have reported how the Program operates by ansvrer- 
ing questions such as: li/ho applies for funds? VJho receives support? 

VJhat projects are proposed? VJhat are the outcomes of the projects? Hovr 
do the Directors of Educational Research^ field readers^ and applicants 
appraise the Program? In these final pages we present the strengths and 
weaknesses of the Program and suggest steps which can be taken by the 
RRP and USOE to rectify the weaknesses. 

Like many other granting programs, the RRP is multi-goaled. Cer- 
tainly, a central goal is '‘resource building." Prxmarily this means 
identifying and supporting less established researchers who seek to 
carry out educationally significant, small-project research. A major 
conclusion of the analysis is that the Program successfully achieves 
this objective. VJhether pre- or post-doctoral, applicants who have 
never received a research grant are more likely than previous grant 
recipients to be funded. Were it not for the RRP, many of these indi- 
viduals may never have proceeded with their research plans. 

In various vrays, the research of these beginners contributes to 
resource building. It enters the classroom, leads to professional 
publications, and strengthens interest in doing further research on 
education. The last effect of the research is fostered by the Program 
in another way. When doctoral dissertation advisors are funded, almost 
all of them involve students in their projects. As a result of this 
experience, they report that their students plan to continue in research 
once the project has been completed. Thus, funding dissertation ad- 
visors serves the dual function of supporting research by a professor 
while simultaneously attracting students to research. 

In addition to resoxirce building, the Program advances the state 
of educational research by attracting researchers trained in various 
disciplines. In this way educational problems are explored from dif- 
ferent theoretical perspectives and by different techniques. Although 
a majority' of applicants specialize in education, almost as many speci- 
alize in disciplines ranging from art to zoology. 

These findings offer strong evidence for concluding that the Pro- 
gram is what it purports to be and merits continued funding. As for 
iitprovement of the Program, the following recommendations are offered; 



1» The administrative budget for the Directors of Edu- 
cational Research should be stabilized, 

2, The research budget for small-project grants should 
be increased, 

3, The $10,000 ceiling for individual projects should 
be raised to $l5,000 plus overhead, 

U, The panel method of review should be continued, 

5, Applicants should be notified of the status of hheir 
proposals within sixty days of submission, 

6, Field Reader comments shovild be sent to every appli- 
cant, 

?• The Directors of Educational Research should offer 
direction to institutions in the selection of 
materials to e^^and their resources for developing 
proposals, 

8, The Directors of Educational Research should in- 
crease their communication vri.th both applicants and 
field readers, 

9, The Guidelines for preparing the proposal document 
should be revised, 

10* Periodic summaries of applicant and proposal data 
should be compiled. 

Recommendation 1: The administrative budget for the Directors of Educa - 

tional Research should be stabilized . 

The most serious shortcoming of the Program is its precarious ad- 
ministrative budget. Unpredictable budget freezes in addition to 
chronic understaffing have plagued the Program since its inception and 
continue to diminish its effectiveness. Anyone associated with the 
Program knotis well that although it has been in existence nearly five 
years, ‘it has yet to have a normal year, that is, one free of budgetary 
crises. 

The budget freezes and inadeqixate staffing in the regional offices 
have only negative consequences. Travel ceases, Dir'ectors cannot 
visit institutions in their regions to develop the research potential of 
institutions and individuals. Processing of proposals is suspended, 
Papervrork in the regional offices continues to mount. These circum- 
stances evoke negative reactions to educational research in general and 
to USOE in particular, l-Jben Directors cannot circxfLate among institu- 
tions in their regions, what justification is there for regionalization? 
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In brief, unstable and insufficient administrative financing nullifies 
the prime advantage of regionalization — contact between RRP staff and 
researchers. 

Despite the frustrating budgetary constraints facing the regional 
offices, ve have been impressed by the dedication of the Program's 
Directors, To a considerable extent, they deserve credit for the accom- 
plishments of the Program, However, the regional offices tend to be 
one-man operations. Over time, this short-sighted economy undermines 
the Program. To build stability into the administration of the Program, 
funds must be provided for clerical help, a professional assistant, and 
travel. It is essential that these funds be exBitpt from freezes. Only 
then can the Directors do the job for X'/hich they have been hired and for 
which the Program has been created. 

The RRP, it appears, is not unlike many other programs at USOE 
Xiihich are launched and then must operate on erratic and inadequate 
budgets,^ Hopefully, the Program wrill not be "phased out" before it has 
been given an opportunity to demonstrate its effectiveness. 



Recommendation 2; The research budget for small-project grants should 
be increased . 

Having studied the Program from several perspectives, we think that 
in addition to stabilizing the administrative budget, the funds for sup- 
porting research should be increased. Generally, if one agrees X'jith the 
claim of many educatoi’s, researchers, government officials, and informed 
laymen that the educational system in the United States suffers from 
serious shortcomings, then it would seem prudent to allocate more funds 
to the RRP for continuing its program of resource development. Moreover, 
as the Program becomes knoxm the volume of applications for research sup- 
port vrill increase. In the final analysis, the image of the Program (and 



report in Science makes the following observations about USOE; 

[it is] difficult to determine which programs [at the 
U.S, Office of Education] are working and which are 
not, since many of the new programs are operating on 
a relative jjittance, 

Neither Congress nor OE has done much about seriously 
evaluating the multitude of programs on the books and 
making improvements where necessary. Drafting and 
passing a law to create a new program is in many ways 
easier and politically more profitable than finding 
out how a program actually works and correcting flaxes 
or abuses, 

Walsh, John, "Education; Nixon Nominates a Schoolman as Commissioner," 
Science , I63 (February 28, 1969), 912-91^. 



its parent organization, USOE) depends not only on how much productive 
research is funded but also on how much is turned away. 



Recommendation 3; The $10,000 ceiling for jjidividual projects should 
be raised to 0l5,OOO plus* overhead . ' 

The recommendation for increasing the research budget of the RRP has 
already been stated, but this increase should be large enough to provide 
for raising the ceiling on individual grants to $l5,000 plus overhead. 
This increment would help compensate for inflated project costs. How- 
ever, the major benefit would be greater flexibility in the choice of 
problems to be studied and research design. 

A higher ceiling vrould permit the collection of data not other^d-se 
possible. At present many IffiP projects use students as subjects, but 
few study the context of the learning environment — the classroom as a 
whole, the school, the home, or the community. Studies of this scope 
typically require a larger expenditure than the $10,000 now awarded. 

The recommendation to raise the ceiling on individual projects 
should not jeopardize the Program's commitment to unsolicited, small- 
project research. By keeping the individual ax^ards at a modest level, 
more researchers can be supported, and the RRP is one of the few federal 
programs providing the researcher on education xd.th an opportunity to 
explore the idea he has developed. 



Recommendation hi The panel method of review should be continued . 

Chaptei- Seven provided considerable data on two systems for review- 
ing proposals (by panel or by correspondence). The majority of field 
readers and Directors consider the panel to be superior. Occasionally, 
technical proposals are best reviewed by specialists. When necessary, 
such revievjs can be obtained by mail and then submitted to a panel to 
permit evaluating the merit of these proposals relative to the others 
being considered. 



Recommendation Applicants should be not ifie d of the status of their 
proposals xathin sixty days of submission . 

One aim of the Program is: 

Processing of proposals from receipt to notification 
of action is usually conpleted within tx-ro months, 
except when complications beyond the control of the 
Regional Office arise. ^ 

p 

" ^Guidelines , op. cit. , p. 6, 
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This statement leads to unrealistic expectations. Tvro-thirds of the 
plicants state that notification took longer than they had expected,-^ 
Marginal comments in their questionnaires dramatize the irritation pro- 
duced by the delay. We recommend that within sixty days of submitting 
his proposal the applicant be informed of the funding decision, or the 
expected date of that decision. The dividends from this procedure vrould 
be substantial. 



Recommendation 6; Field reader comments shoifld be sent to every appli ' 
cant . 



VJhen the applicant is notified of the disposition of his proposal, 
the notification should be accompanied by a copy of the field reader 
comraents. Applicants are eager for constructive criticism and field 
readers themselves endorse the idea. Although the opinions of the Direc- 
tors diverge on this point, those who have not adopted the practice 
are willing to give it consideration. 

In sending comments to applicants, the identity of field readers 
need not be revealed, h His interests can be protected by revising the 
Field Reader Evaluation Form and informing him that his comments will be 
sent to the applicants, A form could be designed that would providg. 
space below a perforation for comments addressed to applicants and 
space above for those intended for USOE exclusively. 



Recommendation 7? The Directors of Educational Research should offer 
direction to institutions in the selection of materials to expand their 
resources for developing proposals . 

Although the Directors conduct seminars, clinics, and individual 
conferences xri.th prospective applicants, we suggest that they also en- 
deavor to assist these applicants by providing guidance to institutions 
in the acquisition of resource materials. To be specific, one of the 
findings reported in Chapter Four was that the probability of being 
funded appears to be related to the number of resources available to 
applicants — not the number they use in developing their proposals. 
Whether an applicant uses a particular resource depends on a number of 
factors, possibly his research training, his experience in writing pro- 
posals, or the stage of his research plan. The important factor is the 
availability of resources at the institution. The \rxdsr the range of 
choice, the greater the opportunity for the researcher to select those 
appropriate to his needs. 



^Table 5,1, 

^It should be noted that the issue of concealed identity is not 
salient to field readers. Not one commented on it in the questionnaire. 
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By my of a reminder, these are the resources liiich are listed in 
the applicant questionnaire: 

1. An "information bank" of agencies that fund 
research 

2. Sample application forms of funding agencies 

3. A "resource person" knotiedgeable about applying 
for research funds 

U. Copies of proposals submitted by others 

5, ERIC materials 

6, USOE' s "Guidelines for Small Project Research" 

7, USOE's "Winning a Research Bid: Tips on Proposal 

tfriting," 

We recommend that the Directors guide institutional efforts to secure 
these resources — most of which are not costly or diffic\ilt to obtain. 
With such materials available, applicants have a greater chance of suc- 
cessf\illy competing for research funds 



Recommendation 8: The Directors of Educational Research sho\fLd increase 

their communication mth both applicants and field readers . 

The Directors seem to have a •uniform image of the Program's research 
policies and practices, but a great many applicants and field readers do 
not kno'vr x-jhether the Program is narrow or broad in its interests, whether 
it is orthodox or vent'uresome, or whether it is strict or lenient in 
allowing departures from the research plans stated in proposals. These 
findings point up a gap in communications. If the Prograjii is to build 
an identity, the Directors must bridge the gap by providing better and 
more frequent information to field readers and applicants. 

The value that can be derived from improving the relationship of 
field readers to the Program should not be overlooked. Their specialized 
knowledge and skills could help the Directors further Program aims. How- 
ever, field readers cannot be helpful unless they are kept up-to-date on 
the Program's activities. Informal discussions co\fLd be held when panels 
are convened, or at periodic regional meetings, or even at the anniaal 
AERA (American Educational Research Association) convention which is 
probably attended by a large proportion of field readers. 



^A summaiy of some material from this report might also be usef\fL to 
prospective applicants, 
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Finally, field readers ought to be notified of the outcomes of the 
proposals they review. Many admit to a certain frustration in spending 
time evaluating a proposal 'and never hearing the granting decision. We 
recommend that field' readers be sent an annual summary of avjards listing 
the project director, the institution, and the title of each stucty". This 
vjould not only inform them of the outcomes of the proposals they had re- 
viewed, but it would also acquaint them with the Program's overall ac- 
tivities. In addition, such a summary would be a convenient i-jay to 
main'tain contact with past and present grantees. 



Recommendation 9: The "Guidelines" for preparing the proposal document 

should be revised. 



The section of the Guidelines entitled "Txie Proposal Document" 
states that^applicants shoul d ' outl ine the proposed research procedures 
carefully. As it turns out, many do not. Typicall. of this lack of 
specificity is the fact that one-third of the researchers who plan to 
study students do not state an approximate sample size. Further, the 
Guidelines do not explicitly request a statement about the planned modes 
of analysis, and one-fourth of the applicants fail to provide this 
information. In conjunction with this, applicants ne^ect to state the 
data processing techniques they intend to use, 

7 

These omissions point up the need to revise the Guidelines , The 
simple injunction to "outline carefully" is an empty instruction unless 
applicants (particularly those who have never pre'viously sought a grant) 
are told what facts to present in the outline. 



Recommenda'bion 10; Periodic summaries of applicant and pr oposal data . 
should be compiled. 



To provide an overview of each fiscal year, we suggest a periodic 
compilation of data from applicants. This need be neither e^qiensive nor 
elaborate. With slight m(jdification, the application form could sexVe 
as the colleciion instrument. These items would be useful; educational 
background, present position, type of institutional affiliation, major 
field of interest. In addition, there should be a fact sheet for the 
proposed research which covers subject matter, study design, expected 
outcome (other tlian the final report) and, where applicable, sample 



^Guidelines , op, cit, , p, 3, 

7a 1 though the Guidelines have been re 'vised and reissued as recently 
as October, 1970, the section entitled, "The Proposal Document," has not 
been ma'fcerially altered since July, 1968, 



characteristics and total costs by item. Some of the questions and 
codes developed for this study covG.d be adapted for this p\arpose. By 
summarizing these facts, the Directors would be informed of the conse- 
quences of their decisions. They vrould learn who is being attracted, 
and the nature of the problems being studied. They may discover areas 
that are underrepresented or not represented at all and, as a result, 
they may id.sh to devote attention to arousing interest in these areas 
among researchers. In sum, the profile of the Program that is being 
suggested here would facilitate planning and provide a basis for policy 
revisions. 

One further comment about the recommendations. We have presented 
only those we consider most iraportant, but all of the research reported 
here offers possibilities for re-examining and improving the Program, 

It is our hope that the Directors x^rill use these materials for just this 
purpose. 



O 

^Subsequent to this study, a taxonomy for proposal data has been 
developed. See Richard V, McCann, "A Data Base and Data Plow Model 
for the Regional Research Program," NCERD, USOE, mimeo, November, 1970. 
Perhaps a similar one will be developed for applicant data. 

13 ^ 
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APPENDIX A 



SAMPLE 



The data for this study of the USOE Regional Research Program 
(RRP) -were obtained from two primary sources. Both the applicants 
submitting proposals to the RRP in Fiscal 1968 and the field readers 
reviemng these proposals were surveyed by mail questionnaire between 
July, 1969 and Ifey, 1970, 



Applicant sample . In July, 1969 a 23 -page printed questionnaire 
consisting of nearly lOQ items xias mailed to researchers x^ho ]iad ap- 
plied to the RRP for a grant during Fiscal 1968, Since everyone had 
not received support, a different version of the questionnaire was 
sent to funded applicants (N = 289 ) than to not funded applicants 
(N = 585). The total sample size was 87 U, 

On September 1, the return rate was only 36 per cent. Follow-up 
postcards were then mailed to all applicants who liad not returned 
completed questionnaires. By September 23, the return rate had 
reached ii6 per cent, somewhat of an improvement, but still not accept- 
able. 



Thereafter, efforts to persuade applicants to complete their 
questionnaires vjere individualized. In most cases, a personally- 
typed letter tos air mailed to the remaining applicants. The letter 
stressed the importance of the applicant' s^ participation in the sur- 
vey and invited him to return an enclosed postcard requesting another 
questionnaire, if somehow the original one had gone astray. These 
letters were effective: close to 5o per cent of these applicants 

either completed the questionnaire or returned the postcard. 

In addition to let ter- writing, contacts by telephone were 
started. Applicants in the New York City area served as test cases, 
and soon thereafter applicants in every region were telephoned. In 
all, some fifty applicants were contacted in this way. Telephoning 
was, of course, more costly and time consuxiiing than letter-writing, 
but it was also more effective. In the end, 85 per cent of the appli- 
cants who -were telephoned completed their questionnaires. 

About fifteen applicants who had not been funded belong in a 
special group. Instead of completing their questionnaires, they sent 
indignant letters. They had no interest in answering questions about 
their proposals idiich had been so rudely turned down. Each of these 
applicants was telephoned to urge him to use the questionnaire for 



registering his complaints. Only one of these applicants refused to 
take advantage of this opportunity. 

In all, 665 questionnaires were returned. The return rate for 
funded applicants was 89 per cent and for the not funded, 73 per cent. 
Table A,1 beloxj accounts for the 87 I 4 . questionnaires which were mailed. 



TABLE A.l 
A.PPLICANT SAMPLE 



Questionnaires mailed 




Nxxmber of 
applicants 


Retxirned and processed 




665 


Not returned 




177 


Dropped from sample: 




32 


Withdraxjals and transfers^ 


12 




2 

Multiple proposals 


11 




Deaths 


5 




Unlocatables 


k 






32 




TOTAL MAILED 


87Ix 



^After mailing questionnaires it was learned 
that the proposals submitted by these applicants 
had been -withdraxvn or transferred to another bureau 
within USOE, 

^Eleven indixn.d'uals had submitted txvo proposals 
in Fiscal 1968, but alternate respondents could not 
be secxired. 



Data from non-respondents has not been completely lost. Partial 
profiles have been obtained from the proposals they submitted. Com- 
parison of the non-respondent data xvith that provided by respondents 
(Table A. 2) shox;s that respondents and non- respondents are alike in 
three respects : 

1, Cooperating institution. A total of 8 I 4 . per cent 
of the respondents and 85 per cent of the non- 
respondents listed a college or university as the 
cooperating institution^ 

A -2 
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TABLE A. 2 



CQ'IPARISON BETV/EEM RESPOMDEMTS AlO NON- 
RESPONDEMTS IN APPLICANT SURVEY 



Information available 
for both groups 


Proportion: 

Respondents Non-respondents 


1. Cooperating institution 






College or university 


.81; 


.85 


School system 


.10 


.08 


Other (e.g., private agency) 


.06 


.07 


TOTALS 


1.00 (665) 


1.00 (i56) 


NA = 


0 


a 




665 


177 


2. Employnent status 






^ployed at least part-time 


.89 


.89 


Student full-time 


.10 


.11 


Other (e.gx, post-doctoral 






fellow) 


.01 


— 


TOTALS 


1.00 (665) 


1.00 ( 168 ) 


NA = 


0 


9 




665 


177 


3. Highest degree 






Ph.D, 


.37 


.la 


Ed,D, 


.17 


.111 


Other (e.g,;, M.A., M,Ed.) 


.ii6 


.15 


TOTALS 


1.00 (66c) 


1.00 (i61i) 


NA = 




13 




665 


177 


[).. Position 






Pull professor 


.18 


.25 


Associate professor 


.19 


.i5 


Assistant professor 


,2h 


.18 


Other faculty (e.g., 






lecturer) 


.05 


.08 


Research director 


.07 


.07 


Administrative officer 


.07 


.09 


Other (e.g., loi'jer school 






teacher) 


.20 


.17 


TOTALS 


i.co (596) 


.99 (lli9) 


NA = 


2 


9 


Not employed 


67 


19 




665 


177 



A-3 
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2. Employment. At the, time the proposal ms sub- 
mitted, 89 per cent of both the respondents and 
the non-respondents were employed at least part- 
time j 

3 . Highest degree. In Fiscal 1968, 37 per cent of 
the respondents held Ph.D.'s; 17 per cent, Ed.D.'s; 
and I 4.6 per cent, other degrees (e.g., M.A., B.A.). 

The percentage figures are similar for non-respon- 
dents: I 4 .I per cent held Ph.D.'s; II 4 . per cent, 

Ed.D.'s; and per cent, other degrees. 

Faculty status is the one item which shovjs a difference betmen respon- 
dents and non-respondents., A higher proportion of junior than senior 
faculty memljers cooperated in the survey, suggesting that the Program 
is of more interest to junior faculty members. Among respondents, 2i| 
per ceht were assistant professors, but only I 8 per cent were full 
professors. For the non-respondents, the figures are reversed; I 8 
per cent were assistant professors, and 2$ per cent, full professors. 



Field Reader sample . Late in March, 1970, an 11-page mimeographed 
questiomaire ms mailed to $12 field readers, the evaluators of the 
proposals submitted to the RRP during Fiscal 1968, The response to 
this questionnaire was prompt and gratifying. By the end of April, 

73 per cent of the field readers had completed questionnaires. Early 
in May a personally- typed follow-up letter ms sent by air mail to 
those idio had not returned questionnaires. As with the letter to the 
applicants, this letter urged field readers to take part in the study; 
it also added that if the questionnaire had gone astray, the field 
reader could return the enclosed postcard requesting another. This 
single follow-up effort increased the return rate to 8$ per cent 
( U 23 que st ionna ire s ) , ^ 

Data abstracted from USOE Field Reader Catalogs permit comparison 
of the present position, highest degree, degree specialty, and year 
degree awarded for respondents and non-respondents. As Table A. 3 
shoi-js, there is no difference in the types of positions held. Ed.D.'s 
are slightly over-represented among the respondents and Ph.D.'s 
slightly ■under -represented. This $ per cent difference carries over 
to degree specialty, A higher proportion of respondents than non- 
respondents specialize in education and a lo'trer proportion in psychol- 
ogy and surprisingly, in English as well. Finally, both groups of 
field readers tend to be young, having received their highest degrees 
within the last ten to fifteen years. The median year for respondents 
is 19$$ and ‘for non-respondents, 19$h» The Program's ability to 
attract young people is not limited to applicants; it extends to field 

^The corrected sample size is I 4 . 98 , Seven field readers could not 
be located and another seven were erroneously sent questionnaires. 



TABLE A. 3 



COMPARISON BETVJEEN RESPOIOENTS AND NON- 
RESPONDENTS INEIELD READER SURVEY 



Background data 


Proportion ; 

Respondents Non -respondents 


1. Position 


Pull professor 


.^1 


.53 




Associate professor 


.11 


.10 




Assistant professor 


.Oil 


.03 




Other faculty (e.g., lecturer) 


.03 


.02 




Research director 


.07 


.08 




Adininistrative officer 


.18 


.16 




Other (e.g., counselor) 


.07 


.09 




TOTALS 


1.01 (396) 


1.01 


(61) 


NA = 


26 




11; 


Retired 


1 

h23 




_0 

75 


2. Highest degree 


Ph.D. 


.61; 


.69 




Ed.D. 


.26 


.21 




Other (e.g., M,A.) 


.11 


.10 




TOTALS 


1.01 (393) 


1.00 


( 62 ) 


NA = 


30 

1|23 




13 

75 


3. Degree specialty 


Education 


.ill; 


.21; 




Psychology 


.26 


.38 




Sociology 


.07 


.02 




Other social science 


,06 


.07 




Mathematics, physical and 


biological sciences 


.07 


.05 




En^ish and language arts 


,06 


• 2li 




Music and art 


oOk 


— 




TOTALS 


1.00 (259) 


1.00 (h2) 


NA = 


l6h 

h23 




33 

75 






[continued] 



Table A. 3 [continued] 



Comparison Bet-ween Respondents and Non- 
Respondents in Field Reader Survey 



Background data 




Cumulative proportion: 
Respondents Non-respondents 


It# Year of degree 








192li-1939 




#10 


#o5 


19l|0-19lt9 




#26 


.26 


1950-195li 




.li7 


.53 


1955-1959 




#72 


.79 


196o-l961i 




.93 


.95 


1965-1968 




1#00 


1#00 




TOTALS 


(358) 


(58) 




NA = 


65 


iZ 






li23 


75 




MEDIANS 


1955 


195lt 



readers# Thus^ if there is any bias in the analysis, it is in favor 
of youth, the hallmark of the Program# 



APPENDIX B 



SUPPLEI'lENTARY TABLES 



TABLE HL.l 

FIVE OUT OF SIX DOCTORAL STUDENTS ARE 
WORKING TOWARD DEGREES IN EDUCATION 



Degree specialty 


Expected 

degree^ 


Proportion of students 
working toward doctorate 


Education 


Ph.D. 


.50 






Ed.D. 


.37 




Discipline 


Ph.D. 


.13 








1.00 


(113) 




Cases excluded"'^ 


hSk 






NA = 


88 








665 



"*"Table restricted to applicants listing the doc- 
torate earned in 1968 or 1969 as the highest degree. 



Not working toward advanced degree. 



TABLE B1.2 



FOUR OUT OF FIVE DOCTOR/i.L STUDENTS BITEi® THE 
RRP RESEARCH FOR THEIR DISSERTATIONS 



Status 


Proportion of applicants 
intending RRP research 
for dissertation 


Number of 
applicants 


Student 






Working toward Ed.D. 


..,83 


(71) 


Working toward Ph.D, 


.80 


(121) 


Working toward Master's 
degree 


.33 


(9) 


Not a student 


.06 


(h^9) 


TOTAL 


.28 


(660) 




NA = 


5 






665 



TABLE B1.3 

NraETY-SEVEN PER CENT OF THE APPLICANTS ARE 'WHITE 



Race of applicant 


Proportion of 
applicants 


White 


.97 


Negro 


.02 


Other (e.g., Indian, Oriental) 


oOl 


TOTAL 


1.00 (6U;) 




NA = 21 




665 



B-2 



^ A 



TABLE Bl.I; 

FIVE OUT OF SIX APPLICANTS ARE MALE 



Sex of applicant 



Proportion of 
applicants- 



Male .83 

Female .17 



TOTAL 1.00 (665) 



TABLE B1.5 

NINE OUT OF TEN APPLICANTS ARE MARRIED 



Marital status Proportion of 
of applican,t applicants 



Married 


.92 




Not married 


.08 




TOTAL 


1.00 


( 638 ) 




NA = 


27 






665 
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TABLE Bl.lO 



THE PARENTS OF Tl-JO-THIRDS OF THE APPLICANTS 
HAD NO MORE THAl'I A HIGH SCHOOL EDUCATION 





Parents of 


applicant 


Formal education 


[Cumulative proportion] 




Father 


Mother 


Eighth grade or less 


.29 


.23 


Some high school 


.III; ' 


.37 


Completed high school 


.63 


.66 


Some college 


.78 


.83 


Graduated from college 


.86 


.9li 


Some graduate school 


.88 


.96 


First professional degree 


.93 


.98 


Master’s degree 


.97 


.99 


Ph.D, or Ed.D« 


1.00 


1.00 


TOTAL 


(6U5) 


(6Ii7) 


NA = 


20 






665 


665 



B-6 
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TABLE B2,l 



PROPORTION OF APPLICAOTS FUNDED BY PREVIOUS 
■RESEARCH GRAWIS 



N'umber of previous 
research grant(s) 



Proportion 
of applicants 
funded 



Number of 
applicants 



None 


: .U3 


One or more 


.3U 


TOTAL 


.38 



(2li9) 

OiO? ) 

(656) 



TABLE B3.1 



THE SUBJECT HATTER OF PROPOSALS VARIES 



Detailed classification Number of 

of subject matter “ proposals 



Agriculture 6 

Art (graphics, painting, sculpture) 10 

Building design 1 

Business 7 

Education (administration, finance, history 

of, teacher training) l 66 

English (cinema, literature, speech, theatre) 37 

Foreign languages and linguistics 12 

Home economics 5 

Industrial arts 6 

Information processing (data retrieval 

systems, library) 20 

Mathematics and statistics 37 

Music 28 

Physical education, health, and recreation 

(dancing) 2h 

Physiological meas'urements $ 

Psychology (including testing and measurement, 

counseling, guidance and placement) 193 

Reading 30 

Science (biological, environmental, or 

physical) 3 ^ 

Social science (including area studies, and 

international relations) » 38 

Speech pathology and audiology 8 

Behavioral science research, environmental 

focus 28 

Subject not elsewhere classified (e.g.. Head- 
start, aviation) U 

Not classifiable by subject (e.g., student 

activism) 3 

TOTAL 710 * 



Total exceeds 665 because more than one subject was indicated 
in some proposals. 




B-8 



r: D 



X 






TABLE B3.2 



THE SAMPLE SIZE PDR STUDENT GROUPS VARIES 



Sample size Proportion of 

proposals 



5o or less 


.20 




5l - 100 


.20 




101 - 200 


.21 




201 - 500 


.21 




501 or more 


.18 




TOTAL 


1.00 


C\J 


Not 


specified 


128 


Not applicable 


288 

^65 



TABLE B3.3 

T'JHEN STUDEI'ITS ARE STUDIED, RACE OR 
ETHNICITY IS SELDOM SPECIFIED 



Race or ethnicity 
of students 


Proportion of 
proposals 


Caucasian 


.50 


Negro 


.U8 


Oriental 


.lU 


American Indian 


.09 


Mexican-Amer ican 


.05 


Other-foreign 


.16 


TOTAL 


l.i;2‘^‘’ (56) 


Not specified 321 


Not applicable 288 

665 



■^otal exceeds 1.00 because more 
than one racial or ethnic group 
indicated. 
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TABLE B3.U 



FEW PROPOSALS FOCUSING ON STUDENTS SPECIFY 
THE STUDENT'S ECONOMIC LEVEL 



Economic level 


Proportion of 
proposals 


Welfare or poverty 


«ii5 


Low- income 


,U8 


FliddLe-inccme 




Upper- income 


.09 


TOTAL 


(,^8) 


Not specified 319 


Not applicable 288 




665 



'^’Total exceeds 1,00 because 
more than one economic group indi- 
cated. 



TiBLE B3,5 

LESS THAN ONE-HALF OF THE HIOPOSALS FOCUSING 
ON TEACHERS SPECIFY THE SAMPLE SIZE 



Sample size 


Proportion of 
proposals 


5o or less 


.37 




5l - 1^0 


.31 




200 or more 


.31 




TOTAL 


.99 


(35) 


Not specified 


h2 


Not applicable 


588 






665 
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TABLE B3.6 



TOTAL COST FCR BUDGET ITEMS 



Total cost 
for budget item" 



Budget Item 

Non-professional Services and 

personnel final report Equipment 

[cumulative proportions] 



J^O^ or less 


.02 


.06 


.n 


106 205 


.09 


.17 


.21 


206 - 305 


.17 


.25 


.31 


306 - Uo5 


.21; 


.36 


.38 


I;06 - 5o5 


.35 


.I;5 


.I;6 


5o6 - 60 5 


.I;3 


.50 


.51 


606 - 705 


.I 4.6 


.58 


.51; 


706 - 805 


.5l 


.63 


.56 


806 - 905 


.^7 


.67 




906 - 991; 


.59 


.69 




995 - 1,991; 


.8U 


.89 


.80 


1,995 - 2,991; 


.95 


.93 


.87 


2,995 - 3,991; 


.98 


.96 


.92 


3,995 and over 


1.00 


1.00 


1.00 


Number of proposals 


(i;59) 




(165) 


No cost listed 


.20 112 


.o5 26 


.71 I ;06 


TOTAL 


(571) 


(?71) 


(571) 


MEDIAN 


fp782 


S 609 


$590 


No budget available 


13 


13 


13 


No local amount stated 


81 


81 


81 




665 


665 


665 



[ continued] 

Budget item costs recorded to the nearest ten dollars. 



Table B3.6 [continued] 



Total Cost for Budget Items 







Budget Item 




Total cost 
for budget item*'' 


Travel 


Employee 

Benefits 


Supplies 
and materials 




[cumulative proportions] 


^105 or less 


.lU 


.15 


.20 ' 


106 - 205 


.29 


.31 


.iiO 


206 - 30 5 


.llO 


.39 


.5li 


306 - li05 


.ll9 


.55 


.62 


1|06 - ^o5 


.56 


.65 


.68 


5o6 - 6o5 


.63 


.75 


. 7 I 1 


6o6 - 'joS 


.67 


.83 


.78 


706 - 8o5 


.73 


.88 


.82 


806 - 905 


.77 


.91 


.85 


906 - 99 li 


.80 


.92 


.87 


995 - l,99li 


.92 


.98 


.9i| 


1,995 - 2,99li 


.96 


.99 


.97 


2,995 - 3,99li 


.98 


.99 


.98 


3,995 and over 


1.00 


1.00 


1.00 


Nvimber of proposals 


0ili3) 


Oi57) 


(5143) 


No cost listed 


.22 128 


. 20 llli 


.05 28 


TOTAL 


(571) 


(571) 


(571) 


MEDIAN 


s^il20 


#37ii 


$276 


No budget available 


13 


13 


13 


No local amount stated 


81 


81 


81 




665 


665 


665 








[contdnued] 



^Budget item costs recorded to the nearest ten dollars. 
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Table B3>6 [continued] 



Total Cost for Budg;et Items 



Total cost 
for budget item‘d 



Budget It on 
Communication 
[cumulative proportions] 





or less 


.lU 


26 


- U5 


.19 


ij6 


- 65 


.39 


66 


85 


.U7 


86 


- io5 


.62 


106 


- 205 


.83 


206 


- 305 


.90 


306 


- Uo5 


.92 


U 06 


- 6o5 


.97 


6o6 


- 8o5 


.98 


806 


- 99h 


.99 


995 


- 2,99U 


1.00 




Number of proposals 


(381) 




No cost listed 


.33 190 




TOTAL 


(571) 




MEDIAN 


o 

ON 




No budget available 


13 


No local amount stated 


81 






665 



[continued] 



lars. 



budget item costs recorded to nearest ten dol- 
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Table B3,6 [cpntirmed] 
Total Cost for Budget Items 



Budget Item 



Total amount 
for item^'" 


Professional Indirect Local 

personnel costs contribution 

[ cumul r.t i ve proportions] 


1J99U or less 


.02 


.17 


.25 


99^ - 1,99U 


.06 


.U5 


.U8 


1,995 - 2,991; 


.13 


.77 


.61; 


2,995 - 3,99U 


.25 


.91 


.70 


3,995 - I;,99I; 


• kl 


.96 


.77 


I;,995 - 5,991; 


.57 


.98 


.86 


5,995 - 6,99U 


.69 


.98 


.86 


6,995 - 7,99k 


.79 


.99 


.88 


7,995 - 8,99U 


.85 


.99 


.90 


8,995 - 9,99U 


.90 


.99 


.92 


9,995 and over 


1.00 


1.00" 


1.00 


Nunber of proposals 


(571) 


(508) 


(571) 


No cost listed 


— 


.12 63 




TOTAL 


(571) 


(571) 


(571) 


MEDIAN 


^5,578 


$2,i52 


$2,10i; 


No budget available 


13 


13 


13 


No local amount stated 


81 


81 


81 







— 







665 


665 


665 

[continued] 


''"Budget amounts recorded to 


the nearest ten 


dollars. 
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Table B3«6 [continued] 



Total Cost for Budget Items 



Federal funds 
requested'^ 


Budget Item 

Comparable All 

budgets proposals 

[cumulative proportions] 


$99li or less 


.00 


.00 


99^ - 1,991; 


.01 


.01 


1,993 - 2,99U 


.03 


.01; 


2,993 - 3,99U 


.07 


.07 


3,993 - U,99i; 


.11 


.11 


1i,993 - 3,991; 


.13 


.16 


3,993 - 6,991; 


.22 


.22 


6,993 - 7,991; 


.28 


.29 


7,993 - 8,991; 


.UO 


.1;! 


8^993 - 9,991; 


,80 


.81 


9,993 and over 


1.00 


1.00 


Number of proposals 


(371) 


(661;) 


MEDIAN 


#9,237 


#9,230 


No amount available 




1 


No budget available 


13 




No local amount stated 


81 






663 


663 

[continued] 



’^Ainount recorded to nearest ten dollars. 



Table B3.6 [continued] 



Total Cost for Budget Items 



Total budget^ 



Funded Not Funded Total 

[cumulative proportions] 





or less 


.07 


.05 


,c6 


^,006 


- 7,^0^ 


.16 


• .Hi ■ 


.15 


7,^06 


- 10 , 00 ^ 


.32 


.30 


.31 


10,006 


- 11 , 00 ^ 


- .Ii7 


.Ii7 


..Ii7 


11,006 


- 12 , 00 ^ 


.^9 


.63 


.62 


12,006 


- 13 , 00 ^ 


.67 


.73 


.71 


13,006 


- Ill, 00 ^ 


.72 


.76 


,.75 


i[.,oo6 


- 1 ^, 00 ^ 


.77 


.82 


.80 


1^,006 


- 17,^0^ 


.86 


.91 


.89 


17,^06 


- 20 , 00 ^ 


.90 


.93 


.92 


20,006 


- 22 ,^ 0 ^ 


• 9 h 


.95 


. 91 ; 


22,^06 


- 2 ^, 00 ^ 


.96 


.97 


.97 


S^2^,006 


and over 


1.00 


1.00 


1,00 


Number of proposals 


( 221 ) 


(350) 


(571) 




MEDIAN 


(i;ii,2^6 


$11,166 


$11,191; 


No budget available 


2 


11 


13 


No local amount stated 


28 




81 






665 


665 


665 



“Amounts upon xirhich total is based are recorded to nearest 
ten dollars. 



TABIE Bh.l 



APPLICANTS -.TTH MORE TRAN THREE RESOURCES AVAILABLE 
HAVE A BETTER. CHANCE OF BEH\fG FUNDED 



Number of 

resources available 


Proportion 
of applicants 
funded 


Number of 
applicants 


One 


.36 


(113) 


Two 


.38 


(lOii) 


Three 




(li|3) 


Foiir 


.U6 


(99) 


Five 


.li5 


(78) 


Six or seven 


.ill 


(81i) 


TOTAL 


.38 


(621) 


No resources available 


31 




Na = 


13 






665 



TABLE Bli,2 

THE DIRECTOR OF EDUCATIONAL RESEARCH IS 
USUALLY THE USOE OFFICIAL i/ffTH VAIOM 
APPLICANTS DISCUSS THEIR PROPOSALS 



USOE official contacted 

Director of Educational Reaearch 

Staff member, Washington, D.C., 

Director of Educational Research and a 
staff member in Washin~t.on, D.C, 

Other (e.g., regional xrtern) 

TCTiiL 

Not discussed uith USOE 

NA = 



Proportion of 
applicants 

.68 



.21 



.07 

.Oil 

1.00 ( 266 ) 

392 

665 



TA3LE 3l|.3 



ALi'IOST ALL FUNDED APPLIC/iNTS FI® DISCUSSING 
THEIR PROPOSALS VJITH A USOE OFFICIAL HELPRJL 





Proportion 


of applicants 


x’XliCl CI3«oClJLoo XOXi WXvxI 

USOE official helpful? 


Funded 


Not funded 


Yes 


.96 


,6k 


No 


,0k 


.36 


TOTAL . 


1.00 (107) 


1.00 (103) 


No discussion 
with USOE 


13h 


258 


NA = ■ 


10 


23 




2^1 


klk (665) 



TABLE BU.U 

APPLICANTS TYPICALLY SPEND ABOUT FORTY- 
EIGHT HOURS PREPARING THEIR PROPOSALS 



Number of hours spent 
preparing proposal 


Cumulative 

proportion 


20 or less 


.17 




21 - UO 


•hh 




iO- - 60 


.61 




61 - 80 


.70 




81 - 100 


.83 




101 or more 


1.00 




TOTAL 




(628) 




NA = 


37 






665 


MEDIAN 


U7.5 


hours 



B-18 
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TABLE Bii.5 



APPLICAOTS IHO SPEND LESS THAN TlvENTY 
HOURS PREPARHvlG THEIR PROPOSALS 
ARE LEAST LIKELY TO BE FUNDED 



Number Q.f.ho.ur^ spent 
preparing proposal 


Proportion 
of applicants 
funded 


Number of 
applicants 


20 or less 


.33 


( 106 ) 


21 - I;0 


.35 


(169) 


la - 60 


.la ■ ■ 


(108) 


61 - 80 


.38 


m 


81 - 100 


.38 


(82) 


101 or more 


.39 


( 108 ) 


TOTAL 


.38 


(628) 




NA = 


37 






665 



TABLE Bh,6 

A MAJORITY OF THE APPLICANTS PREPARE 
PROPOSALS ON THEIR a*JN TIME 



Time used to prepare proposal 


Proportion of 
applicants 


Oxm time 


.53 


Both own and working time 


.28 


Working time 


.19 


TOTAL 


1,00 (658) 




NA = 7 




665 
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TABLE B^.7 



THE MEDIAN CLERICAL COST FCR PRE- 
PARB'IG A HOPOSAL IS 1^8 



Clerical costs 


Cumulative 

proportion 




Less than $2$ 


.22 




$2$ - $U9 


.53 




^i;5o - $99 


.80 




$100 or more 


1.00 




TOTAL 




(619) 


Cannot 


guess the cost 


hi 




NA = 


5 

665 


MEDIAN 




CO 



! 

I 



\ 

i 
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TABLE b5.1 



SEVEN OUT OF TEN NOT PUNDED APPLICANTS ASK FOR 
AN EXPLAPIATION OF THE GR/J'ITING DECISION 



Did you ask for Proportion of not 

an explanation? funded applicants 

Yes .71 

No .29 

TOT.AL 1.00 (i|09) 

NA = 5 

Cases excluded"*^ 2^1 

665 



^Funded applicants. 



TABLE B5.2 

FOUR OUT OF FIVE NOT FUNDED APPLICANTS ARE 
DISSATISFIED IVETH THE EXPLANATION 
OF THE GRANTING DECISION 



Satisfaction with 
explanation of 
decision 


P!roportion of not 
funded applicants 


Not satisfied 


.81 




Fairly satisfied 


.17 




Very satisfied 


.02 




TOTAL 


1.00 


(26h) 




NA = 


29 


Did not ask for an 
explanation 


121 


Cases 


excluded''’" 


25i 






665 



'^‘Funded applicants. 
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TABLE B6.1 



MOST RRP PROJECTS IvERE NEARLY COMPLETED OR 
COMPLETED AT THE TEE OF THE SURVEY 



Stage of research project 



Proportion of 
funded applicants 



Grant just reqeived 


*02 




One-fourth completed 


*01 




One -half completed 


,08 




Three-fourths coit 5 )leted 


*13 




Nearly completed 


*28 




Completed 


*i|8 




TOTAL 


1*00 


(2k9) 




NA = 


2 


Cases 


excluded'^ 








665 



%ot funded applicants* 



TABLE B6.2 

TW OUT OF THREE RRP PROJECTS 
HAVE STUDENT ASSISTANTS 



Student assistance 
on project? 


Proportion of 
funded applicants 


Yes 


.66 




No 






TOTAL 


1*00 


CsJ 




NA = 


1 


Cases 


excluded"’^ 








665 



'^Not fiuided applicants* 
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TABLE B6.3 



TIO-THIRDS OF THE FUNDED APPLICANTS PRESENT PAPERS 
BASED ON THEIR PROJECTS AT PROIESSIONAL MEETINC5S 



Present a paper at a 
professional meeting? 


Proportion of 
funded applicants 


Yes 


.67 


No 


.33 


TOTAL 


1.00 (222) 


Cases excluded'^ 




66 $ 



“Not fvtnded applicants (N = ipLl;); 
funded applicants whose project has just 
begun (N = 29). 
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TABLE B6.U 



SIX OUT OF TEN 
PROJECTS AT 



FUNDED APPLICANTS PRESENT PAPERS BASED ON THEIR 
NATIONAL MEETH'IGS OF PROFESSIONAL SOCIETIES 



Type of meeting 


Proportion of 
funded applicants 


National meeting 




Regional meeting 


.13 


Invited lecture 


,11 


State meeting 


.09 


National, regional, and state 


meeting ,07 


Regional and state meeting ■ ' 


,06 


National and state meeting 


,o5 


National and regional meeting 


,oh 


International meeting 


,03 




TOTAL 1,03’'^ (l55) 

No paper presented 6? 
Cases exclude d'''‘*"‘ 

"6^ 



'‘Total exceeds 1,00 because some funded applicants also 
present papers at international meetings, 

''^%ot funded applicants (N = UlU) ; funded applicants 
T-diose project has just begm (N = 29) • 



TA3LE B6.^ 



SEVEN OUT OF TEN FUNDED APPLICANTS PREPARE MANUSCRIPTS 
FOR PUBLICATION BASED ON THEIR PROJECTS 



Prepare a manuscript 
for publication? 


Proportion of 
funded applicants 


les 


.72 


No 


.28 


TOTAL 


1.00 (222) 


Cases 


excluded’' lili3 




66 $ 



"Not funded applicants (N = 
funded applicants whose project has just 
begun (N = 29). 
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170 



TABLE B 6.6 



FUNDED APaiCANTS MOST FREQUENTLY 1®ITE JOURNAL 
ARTICLES BASED ON THEIR PROJECTS 



Type of manuscript( s) 


Proportion of 
funded applicants 


Joiimal article 


.12 


Journal article and book or part 
of a book 


.11 


Book or part of a book 


.06 


Other (etg., limited circulation 
report^ musical score, test 
manual) 


• 

0 

CO 


Journal article and other 


.01 


Book or part of a book and other 


.01 


Journal article, book or part of 
a book, and other 


.01 


TOTAL 


1.00 ( 171 ) 


No plans 


to publish 5l 


Cases 


excluded'^ kh3 




665 



’%ot funded applicants (N = I 4 II 4 .) ; fvmded applicants 
whose project has just begun (N = 29 ) • 
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TABLE B6,7 



SEVEN OUT OF TEN FUNDED APPLICANTS REPORT THAT 
RRP EXPERIENCE FAS STRENGTHEI^IED THEIR 
INTEREST IN RESEARCH ON EDUCATION 



Effect of funding 
. on research interest 


Proportion of 
funded applicants 


Strengthened interest in 


doing 






research on education 




.71 




No appreciable effect 




.26 




Diminished interest 




.03 






TOTAL- 


1.00 


CO 

CM 






NA = 


3 




Cases 


excluded" 










665 



funded applicants. 



TABLE B6.8 

THREE OUT OF POUR FUNDED APPLICANTS REMAIN 
AT THE SAIiE INSTITUTION AFTER 
STARTBIG THEIR RESEARCH 



Institutional 

affiliation 


Proportion of 
funded applicants 


Same 


.IS 




Different 


.25 




TOTAL 


1.00 


(232) 




NA = 


5 


Not 


employed 


11; 


Cases 


excluded" 


[|li; 






665 



’*Not funded applicants. 



B-27 

17 ^ 



TABLE B7.1 



FOUR OUT OF FIVE FIELD READERS IJHO REVIE7JED 
PROPOSALS DURING FISCAL YEAR 1968 
ARE STILL FIELD READERS* 



Currently under contract 
to USOE as a field reader? 


Proportion of 
field readers 


Yes 


.82 


No 


.18 


TOTAL 


1.00 O4I6) 




NA = 7 




h23 


*June, 1970 . 



TABLE B7.2 




VIRTUALLY EVERY FIELD READER HAS 
SERVED AS AN ^DIVIDUAL REVIEV/ER 


Reviewed RRP proposals as 
an individual field reader? 


Proportion of 
field readers 


Yes 


.99 


No 


.01 


TOTAL 


1.00 (37^) 



•EABLE B7.3 



ONLY Oi'ffl OUT OF FOUR FIELD READSRS HAS 
PARTICIPATED IN A PANEL IffiETING 



Participation in 
panel meeting? 


Proportion of 
field readers 


Yes 


.27 


No 


.73 


TOTAL 


1.00 (ia9) 




NA = k 




h23 



TABLE B7.U 

®E OUT OF THREE FIELD READERS PREFER THE 
PANEL SYSTEM FOR RBVIEraG PROPOSALS 



Preferred system for 
reviexdjig RRP proposals 


Proportion of 
field readers 


At 3 panel session 


.33 


By correspondence 


.07 


Cannot compare the tuo systems 


.60 


TOTAL 


1.00 (398) 




NA = 25 




h23 
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TABLE B7.5 



Sa^E PIELD READERS APPROVE ADDING CRITERIA 
TO THE FOUR NOW USED TO EVALUATE PROPOSALS 



Additional criteria 


Proportion of 
field readers 
approving 


Suitability for replication 


,56 


Significance beyond education 


Ml 


Creativity of researcher 


M2 


TOTAL 


l,U5"' (l6i) 




NA = 262 




U23 



^otal exceeds 1,00 because field readers 
could recommend more than one criterion. 
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STUDY OF 



SMALL-PROJECTS PROGRAM 



Supported by 

United States Office of Education 



Columbia University 
Bureau of Applied Social Research 
605 West 115th Street 
New York, New York 10025 



m 



r 



STUDY OF SMALL-PROJECTS PROGRAM 



This qttestiowiain' is directed to the mnn you received from the U.S. Office of Education for the project entitled: 



on project 



rule 



Name (Please print} 



First, we v/orlrl iike to learn about your professional activities. 



1 - 6 / 

1 . In the last five years have you been engaged in any oilier researcli projects? 



Please check for each of the years listed below 





Engaged in 
Research on 


Engaged in 
Research Other 


Not Engaged 




Education 


Than Education 


in Research 




(1) 


(2) 


(0) 


1968 


It □ 


□ 


□ 


1967 


8/ □ 


□ 


□ 


1966 


9/ □ 


□ 


□ 


1965 


10/ □ 


□ 


□ 


1964 


11/ □ 


□ 


□ 



Have you ever received another research grant from any of the following sources? 

Check all that apply 
12/ 1 □ USOE 

2 □ Another government agency 

3 □ A private foundation 

4 □ Your own institution 

9 □ Other (Plense specify) 

0 □ No grant received 




17 / 



3. \ .lat cooperating institution was listed on the title page of your proposal? 



22/ 1 □ C'ollege or University 






(a) To what subdivision did you belong? 



Check as many as apply 
24/ 1 □ School or Department of Hducalioii 

2 □ Liberal Arts Department 

3 □ Research Institute or Bureau 

9 □ Other (Please specify) 



Discipline 



Cily and State 



(b) If an instruetional unit: Was the enrollment of the division undergraduate or graduate students, or 
was it both? 



25/ 1 n Undergraduate 

2 □ Graduate 

3 □ Joint undergraduate/graduate 



2 □ State Department of Education 



State 



3 □ School System 

Name Ci ty and S ta te 



4 □ P»*ivate Agency 

Name City and State 



9 □ Other (Please specify) 



4. At the time you submitted this proposal, what was your employment status? 

Check as many as apply 
26/ 1 □ Employed full-time 

2 □ Employed part-time 

3 □ Graduate student full-time 

4 □ Graduate student part-time 

9 □ Other (Please specify) 



If Employed 

(a) 1 □ At cooperating institution 
2l! Or 

2 □ Elsewhere 

Name of Institution 

(b) Beginning date of employment 

Year 

28-29/ 

(c) Position when submitted proposal 



If Graduate Student 

(a) 1 □ At cooperating institution 

32/ Or 

2 □ Elsewhere 

Name of Institution 

(b) Date of matriculation 





Title 

30-31/ 



Month 

33-34/ 



Year 

35-36/ 



5. (a) 



At the lime you submitted your proposal, what was your major field or specialty? 



Fleasc check only one 

Education 

37/ 1 □ Administration 

2 □ ('urriculum 

3 □ Research and Statistics 

4 □ Teacher Training 

9 □ OihcY ( Please specify ) 

Psychology 

38/ 1 □ Developmental 

2 □ Guidance and Counseling 

3 □ Learning 

4 □ Personality 

5 □ Testing and Measurement 

9 □ Oihex (Please specify) 

Social Science 
39/ 1 □ History 

2 □ Political Science 

3 □ Sociology 

9 □ 0{\\Qx (Please specify) 

X □ Othex f\e\d or specixiMy (Please specify) 

(b) Within your major field, were you specializing in one or more of the sub-areas listed below? 

Check all that ap''fh’ 

40/ 1 □ Pre-school 

2 □ Elementary 

3 □ Secondary 

4 □ College 

5 □ Graduate 

6 □ Adolescent 

7 □ Adult 

8 □ Vocational 

9 □ Distributive 
0 □ None 

X □ Oihex (Please specify) 



6. In what activities were you engaged when you submitted the proposal to USOE? 

Please give your best estimate of the time you spent on each activity 
Per cent 



of time Activity 

41-42/ Curriculum or educational program development 

43-44/ Research (other than for a course or degree requirement) 

45-46/ Services (school surveys, consultation, test administration or scoring, workshops, 

47-48/ Working toward an advanced degree: 

49/ 1 □ M.A. 2 □ Ed.D. 3 □ Ph.D. 

50-51/ Teaching 

52*53/ Other (Please specify, e.g., administration) 




-3- 

17J 



100"r 



DEVELOPMENT OF PROPOSAL 



7. How did you first learn of the USOE Regional Resc^^reh Program? 

54/ 1 n Oral presentation of the program by a USOE official 

2 n Personal contact with a USOE official 

3 □ Through CORD, the program for developing research capacities at institutions of higher education 

4 □ From a colleague, supervisor, dean, or research coordinator 
0 □ Cannot recall 

9 □ Other (Please specify) 

8. How did you plan to conduct the research described in the proposal? 

Check one 

55/ 1 □ As a staff member of a research organization (e.g., a Center, Bureau, Institute, or similar unit that 
conducts more than one study at a time) 



Name of research unit Supporting institution City and State 

2 □ As a non-staff member of a research organization who would use the facilities or equipment (e.g., 
computer, library, clerical staff) 



Name of research unit Supporting institution City and State 

3 □ As an independent study director not connected with a research organization 

9. Was this project the first one you directed or co-directed? 

56/ 1 □ Yes 2 □ No 

10. Did you intend the proposed research for a doctoral dissertation? 





57 / 1 □ Yes 


2 □ No 


If Yes, please check one: 


58 / 2 □ Ed.D. 


3 □ Ph.D 



1 1 . Thinking back, would you say you had some well-defined research plans before you thought of applying to the 
Regional Research Program? 

59/ 1 □ Yes, research plans were well-defined before applying to the program. 

2 □ No, had general idea for research but did not think out details until after dec.ii g to apply to USOE. 

3 □ No, did not develop the idea* for this research until I knew about the program. 

i4o 



12 



Had you previously suhniittcd a similar proposal to a funding agency? 



60 / 1 □ Yes 2 □ No 



If Yes: (a) What was the agency? 



61 - 63 / 



(h) Did you have to rewrite the proposal before submitting it to the Regional Research 
Program? 



64 / 1 □ Yes 2 □ No 

If Yes: What modifications did you make? 

Check all that apply 

65 / 1 □ Restricted the scope of the project to stay within the $10,000 ceiling. 

2 □ Expanded the research plans to take advantage of the $10,000 ceiling. 

3 □ Focused the project more towards educational problems. 

9 □ OW\(^x (Please specify) 



13. Was the proposal written to extend research in the same specialty in which you had been working, or to begin 
research in another specialty? 

66/ 1 □ To extend research in a specialty in which I had been working 
2 □ To begin research in another specialty 



14. (a) When you were preparing the proposal, did you have access to any of the following resources at your 

institution? 

(b) And, which did you use? 

Check all that apply 





(a) 


(b) 




Available 


Resources 




Resources 


Used 


An “information bank” of agencies that fund research 


67 / 1 □ 


68 / 1 □ 


Sample application forms of funding agencies 


2 □ 


2 □ 


A “resource person” knowledgeable about applying for research funds 


3 □ 


3 □ 


Copies of proposals submitted by others 


4 □ 


4 □ 


ERIC materials 


5 □ 


5 □ 


USOE’s “Guidelines for Small Project Research” 


6 □ 


6 □ 


USOE’s “Winning a Research Bid: Tips on Proposal Writing” 


7 □ 


7 □ 



79 - 80/05 

1-6 



15. Wlien you submitted this proposal, did you personally know anyone at your institution who was engaged in 
research that was being funded by an outside agency? 

7 / 1 □ Yes 2 □ No 

If Yes: Was any of this research supported by USOE? 



8/ 1 □ Yes 



2 □ No 



3 □ Don’t know 



16 . 



Docs your institution have a policy that requires one or more staff members to critically review a proposal 
prior to submission? 



9/ ^ □ Yes 2 □ No 



3 □ Don’t know 



17. Apart from institutional requirements, did you ask anyone to critically read your proposal? 

10/ 1 □ Yes 2 □ No 

18. If anyone critically read your proposal: 

(a) What was his position? 



(b) 





Check all that apply 




Within your 


Outside \ 




institution 


instituti 


Research specialist on education 


11/ 1 □ 


12/ 1 □ 


Researcher in a behavioral science 


2 □ 


2 □ 


Researcher in another discipline 


3 □ 


3 □ 


Dissertation advisor 


4 □ 


4 □ 


Colleague or peer 


5 □ 


5 □ 


Admini.strator 


6 □ 


6 □ 


Research coordinator 


7 □ 


7 □ 


Bureau director 


8 □ 


8 □ 


OW\e\ (Please specify ) 


9 □ 


9 □ 


As a result of these reviews, did you make any of the following changes? 


Check all that apply 







13/ 1 □ Modified the research design 

2 □ Incorporated more detailed review of previous research 

3 □ Pointed up the educational significance of the project 

4 □ Emphasized the potential application of the results 

5 □ Arranged for more extensive consultation 

6 □ Included a more complete description of the qualifications of the project personnel 
14/ 1 □ Des.''ribed the research facilities more explicitly 

2 □ Extended the bib’*''graphy 

3 □ Corrected editorial or stylistic weaknesses (e.g., sentence structure, wording, or organization 

of material) 

4 □ Revised the budget 

5 □ Changed the time schedule 
0 □ None of these changes 

9 □ Oihtx z\\dn%Q^ ( Please specif y j 



ERIC 
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Before you officially submitted the proposal, did you informally discuss it with anyone from the USOE 
Regional Office or from Washington? 

15/ 1 □ Yes 2 n No 

If Yes: fa) With wliom did you discuss the proposal? 

16/ 1 □ Regional Director of Educational Research 
2 □ Staff member from Wasliington 
9 □ 0{\\QX (Please specify ) 

(b) Was the discussion helpful? 

17/ 1 □ Yes 2 □ No 

20. As far as preparing the proposal, how wDuId you characterize the USOE’s help? 

Check one 

18 / 1 □ They provided all the help I needed. 

2 □ I wish that they had been more helpful. 

3 □ I didn’t seek any help from USOE. 



21. Who paid the clerical costs of preparing the proposal? 

Check one 

19/ 1 □ My department or institution 

2 □ The costs came out of another research project. 

3 □ I paid for them personally. 

9 □ 0{\\ex ( Please specify ) 

22. It is uifficult to calculate a precise figure, but what would you guess the clerical costs of your proposal 
amounted to? 

Check one 

20/ 1 □ Less than $25 
2D S25 - $49 

3 □ $50- $99 

4 □ $1 00 or more 

0 n Cannot guess the cc:t. 

23. Altogether, about how many hours did you actually, spend preparing the proposal? 



Approximate number of hours 
21-23/ 

24. Did you prepare the proposal on your own time or on working time? 

24/ 1 □ On my own time 

2 □ On my salaried working time 

9’ □ Qi\\ex ( Please specify ) 
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PROCESSING THE PROPOSAL 



25. I'ickl readers evaluate each proposal accortling to four criteria: ( 1 ) educational signiUcance, (2) soundness ot 
research design: (5) adequacy of personnel and facilities; and (4) economic clliciency. 

(a) Do you think it is appropriate for each proposal to be judged by all of these criteria? 

25/ 1 □ Yes 2 □ No 

If No: Which one(s) should bo eliminated? 

26/ 1 □ l:ducational significance 

2 □ Soundness of research design 

3 □ Adequacy of personnel and facilities 

4 □ Ix'onomic efficiency 

(b) D(.) you think that any other criteria should be added? 

27/ 1 □ Yes 2 □ No 

If Yes: Please specify the criteria 



28-29/ 

26. Do you think that a copy of the comments made by field readers should be sent routinely to each applicant? 
Please check only one 

30/ 1 □ Yes, these comments should be sent routinely to every applicant. 

2 □ Yes. but only to an applicant whose proposal has been rejected. 

3 □ Yes, but only to an applicant whose proposal has been funded. 

4 □ No, I don't think the field reader comments should be sent to any applicant. 

0 □ I have no opinion. 



27. It is not unnatural for field readers to be influenced by their own professional interests and experiences. For 
each of the groups listed below, please indicate the kind of reviewer who would be most likely to recognize the 
distinctive aspects of your proposal. 

Check one under each heading 
Discipline of reviewers 
31/ 1 □ Education 

2 □ Psychology 

3 □ Sociology 

0 □ No preference 

9 □ Other/' Please sp ecif\ 

Research interest of reviewers 
32/ 1 □ Basic research 
2 □ Applied research 
0 □ No preference 

9 □ Oiber (Please specify) 

Locale of reviewers 
33/ 1 □ Major university 

2 □ Small college 

3 □ Non-academic setting, such as a state department of education or school system 
0 n No preference 

9 n Other (Please specify) 




28 . 



Did you have to wait less lime or a longer lime lhan you expecled lo learn lhal Ihe proposal was funded? 



34 / 1 □ Less lhan I expecled. 

2 □ Aboiil what I expecled. 

3 □ Somewhat longer lhan I expecled. 

4 □ Considerably longer lhan I expected. 

38 / 

39 - 40 / 

29. Before contracting for this research, did the USOE Regional Office require changes in the proposed research? 

Check all that apply 
7 2/ 1 □ Research design 

2 □ Data collection inslriimenls 

3 □ Sample 

4 □ Planned modes of analysis 

5 □ Budget 

6 □ No changes required 

9 □ 0\.\\Qx (Please specify) 

If changes required: How did you feel about making these changes? 

Check one 

73 / 1 □ They probably strengthened the research. 

2 □ They were of small consequence. 

3 □ They proh'>bly detracted from the research. 

30. Did you begin the research on the proposed starting date? 

74 / 1 □ Yes 2 □ No 

If No: What problems did the change of starting date create, if any? 

Check all problems that apply 
75 / 1 □ Data collection 

2 □ Own v*^ork schedule 

3 □ Recruiting staff for the project 

4 □ Paying project costs 

5 □ Contracting for equipment 
0 □ No problems 

9 □ Other (Please specify) 

79 - 80/06 

31. Was there anything else especially noteworthy, either positive or negative, about the way the USOE Regional 
Office processed the proposal? 



□ Yes □ No 





If Yes: Please jot do\\>n your comments here. 



CONDUCTING THE RESEARCH 



1 - 6 / 

32. Wore you rcriuired to .iblain clearance from the U.SOli lot any data-colicclion in.struincnls used in tliis 
rcscardi? 

7/ 1 □ Vos 2 □ No 



If Ye.s: (a) How long did lake to gel clearance? 

Approximate nu^nher of weeks 
8-9/ 



(b) Did the lime required for clearance create any problems? 
Cheek one 

10/ 1 □ It created major obstacles. 

2 □ It created minoi tdislaclcs. 

3 □ It created no paiiicula obstacles. 

(c) Did the IJSOH clearance require changes in aov inslrumcnis’.' 

Check all that apply 
11/ 1 □ Deletion of items 

2 □ Addition of items 

3 □ I'diling of items 

4 □ Hnlire instriimenl(sj discarded 
0 □ No changes 

9 □ Oihex (Please specify) 

(d) Was this USOF clearance helpful, or was it a hindrance? 
Check one 

12/ 1 □ Yes, I'leipful. 

2 □ No, a hindrance. 

3 □ It didn’t affect the research one way or another. 



33. Few researchers can anticipate all the contingencies that arise m a research project. While carrying out this 
research, did you have to depart from your plans? 

Check phases of research recuiring departures from plans 
13/ 1 □ Sample 

2 □ Amount of time planned for data collection 

3 □ Modes of analysis 

9 □ Oih^x ( Please specify j 

0 □ I did not havj to depart from my original plans in any appreciable way. 

34. Did you encounter problems “n obtaining tlie cooperation of schools or access to subjects? 

14/ 1 □ Major problems 3 □ No problems at all 

2 □ Minor problems 4 □ Not applicable 

35. Did you have major difiiculty obtaining project help of the following kinds? 

Check all that apply 
15/ 1 □ Clerical help 

2 □ Research assistants 

3 □ Cooperation of adminfstrators at your institution 

4 □ Assistance of cons 'hants (or advisors vhen needed 
0 □ No major difficulty 



- 10 - 
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Did you find tliat so n. 'ch time was 
originally platincd? 

16/ 



spent collecting the data that less time for analysis was available 
1 □ Yes 2 □ No 0 n No data collected 



than 



37. Did you discover llial the project liad been underbudgeied in any of llie following respects? 

Check all that apply 
17/1 □ Personnel 

2 □ I’ravel 

3 □ Supplies and materials 

4 □ Communications 

5 □ Services 

6 □ Equipment 

0 □ Project was not underbudgeted 

9 □ Oihex (Please specify) 



38. 1 lave you prepared any progress reports for the USOE Regional Office? 

18/ 1 □ Yes 2 □ No 0 □ None was required 

If Yes: Was tbe preparation of tbe progress report much cf a problem? 

Check one 

19 / 1 □ No, preparing the progress report was a request easily met. 

2 □ No, but the time could have been better spent. 

1 □ Yes, it was a chore to prepare tbe progress report. 

9 □ Other (Please specify) 



29. Have you submitted a final report on the project to the USOE Regional Office? 

20/ 1 □ Yes 2 □ No 



If Yes: (a) Was the final report completed within the grant period? 

21/ 1 □ Yes 2 □ No 



(b) Are you currently engaged in research? 

Check all that apply 

22/ 1 □ 1 am engaged in research on education. 

2 □ I am engaged in research in another field 

3 □ 1 am not engaged in research. 



Name of field 



40. If you have not completed this research project, how far have you progressed? 

Check one 

23/ 1 □ I have just received the grant. 

2 □ About one-fourth of the work has been completed. 

3 □ 1 am about haif-way through. 

4 □ 1 am about three-fourths of th : way through. 

5 □ 1 have nearly completed the research project. 

41. Have you submitted another proposal O the Regional Research Program? 

24 / : □ Yes 2 □ No 

If Yes: What is the status of this proposal? 

25/ 1 D Funded 2 □ Pending 3 □ Rejected 



- 11 - 




■ i 



RESULTS OF TIIL RESLARCII 



A2. Ihivc ;mv sUkIlmus jssislctl you on this project? 



26/ 1 □ Yes 



2 □ No 



It Yes: As a result of tlieir experience on this project. Itave any of tliem dceitled tliey will do further work in 
research? 



27/ 1 □ Yes 



2 □ No 



3 □ Don't know 



43. Has this project been discussed in any class? 

Check all that apply 

28 / 1 □ Yes. (.liscussed hut no data presented. 

2 □ Yes. discussed and pri^jeet data presented. 

3 □ N(.). not di.se us.sed. 

0 □ Not applicable 

44. lias this re.scarch led to the additioit of new ntatcrials to course reading lists? 



45. Arc data- from tliis project being used by students for independent study projects? For master’s essays? For 
doctoral dissertation.s? 

Check all that apply 
30/ 1 □ Independent study projects 

2 □ Master's essays 

3 □ Doctoral dissertations 
0 □ Not applicable 



46. Have you encouraged any students to pursue this line of research for independent study projects? For masterN 
e.ssays? For doctoral dissertations? 

Check all that apply 
31/ 1 □ Independent study projects 

2 □ Master’s essays 

3 □ Doctoral dissertations 
0 □ Not applicable 



47. Since you liave undertaken tliis project, do you find that students are more lik'-ly to seek your advice 
regarding M.A. or doctoral tlieses? 

Check one 

32/ 1 □ Students are more likely to seek my advice. 

2 □ There is no noiiceable change. 

3 □ Students are less likely to seek my advice. 

0 □ Not applicable 



29/ 1 □ Yes 



2 □ No 



48. 



As a result of this research, have you recommended that any course or curriculum content be modified? 



Check all (hat apply 
33/ 1 □ 1 have planned a new course. 

2 □ I have revised one or more courses. 

3 □ 1 have recommended greater emphasis on certain topics, or the addition'of new materials. 

4 □ I have suggested courses in allied disciplines to students. 

9 □ Oihex (Please specify ) 

0 □ I have not recommended any changes. 



49. Have you been invited to discuss this research with a faculty or student group? 



Check at! (hat apply 

34/ 1 □ Faculty sen.inar in my department 

2 □ Interdepartmental faculty seminar 

3 □ Faculty-student seminar in my department 

4 □ Interdepartmental faculty-student seminar 

5 □ Student society 

0 □ Have not been invited 



50. Have you presented (or will you present) a paper based on this project at a state, r 'onal, or national meeting 
of a professional society? 



35/ 1 □ Yes 2 □ No 

If Yes: Please check any that apply 

36/ 1 □ A state meeting of a professional society 

2 □ A regional meeting 

3 □ A national meeting 

9 □ Other (Please specify) 



51. 



Are you writing (or have you written) any manuscripts for publication based on this research? 

37/ 1 □ Yes 2 □ h 

If Yes: What does this include? 

Check all that apply 

38/ 1 □ A journal article If Published: *. • 

Name of journal 



39-40/ 



2 □ A book or part of a book 



Title 



9 □ Oth^r (Please specify) 



If you have no plans to publish, p/earje state your reason for not doing so. 





41-42/ 



52 Have you received reijiiesls for copies of any written materials based on this project? 

Check all that apply 
43 / 1 □ Proposal 

2 □ Instruments used in the research 

3 □ Preliminary report 

4 □ Project memoranda, etc. 

5 □ Final report 

0 □ No requests received 

9 □ 0\hc] (Please specify) 



5.^. As a result r)f this res , arch, have you received any of the following requests or invitations? 



Check each item 





Yes 


No 




( 1 ) 


( 2 ) 


44 / 


□ 


□ 


45 / 


□ 


□ 


46 / 


□ 


□ 


47 / 


□ 


□ 


48 / 


□ 


□ 


49 / 


□ 


□ 



Asked by a colleague to critically read a paper. 

Asked by a journal tC) evaluate an article on a related topic. 

Asked by a journal to review a book on a related topic. 

Approached by a publisher about writing a book on this subject. 

Asked by a funding agency to evaluate a proposal in this or a related area of research. 
Invited by a funding agency to submit a proposal for further research in the area. 



54. Since you have had this research experience, have you been asked to serve as a consultant for any of the 
following groups? 

Check all that apply 
50 / 1 □ Board of Education 

2 □ State Department of Education 

3 □ federal Government 

4 □ Commercial producer of learning materials 
0 □ No requests received 

9 □ 0[\\ex (Please specify) 



55. Was your teaching load reduced to enable you to devote more time to this research? 

51 / 0 □ Do not teach 
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1 □ Yes 



2 □ No 



56. As a result oi working on tills project, have you improved your skills in any of the tollowing areas? 



Check all (hat apply 

52/ 1 □ Supervising research assistants 

2 □ Expository writing 

3 □ Research budgeting 

4 □ Developing a research design 

5 □ Sampling techniques 

6 □ Survey techniques (interviewing, questionnaire construction) 

7 □ Locating relevant literature through ERIC 

8 □ Utilizing general library resources 

9 □ Computer programming 

0 □ Modes of analysis, such as: 

53/ 1 □ Analysib of covariance 

2 □ Analysis of variance 

3 □ Correlation or regression analysis 

4 □ Descriptive analysis (non-analytical) 

5 □ Discriminant function analysis 

6 □ Factor or cluster analysis 

7 □ Qualitative or historical analysis 

8 □ Tests of significance (t tests, chi-square, non-parametric, etc.) 

9 □ Oiher( Please specify) 



57. WItat effect has this researcli experience liad on your interest in doing research on education? 
Check one 

54/ 1 □ It has strengthened niy interest in doing research on education. 

2 n It lias not appreciably affected my interest. 

3 □ It has diminislied my interest in doing research on education. 



CAREER ACTIVITIES AND OIMNIONS 



58. What is your employment status now? 

Check as many as apply 
55/ 1 □ Employed full-time 

2 □ Employed part-time 

3 □ Graduate student full-time 

4 □ Graduate student part-time 

9 □ Oihex (Please specify) 

If not employed, SKIP TO QUESTION 62. 

S’*). Arc you still employed by the organization where you were when you submit led the proposal to USOE, or 
have you moved? 



(c) At this new organization, about how much lime do you devote to research? 
Check one 

65/ 1 □ More time than at former location 

2 □ About the same amount of time 

3 □ Less time than at former location 
0 □ None 

(d) Did this move to another organization represent a promotion? 



Check one 



56/ 1 □ Yes, I am Still employed at the same organization. GO TO QUESTION 60. 
2 □ No, I have moved. 



If Moved: (a) What is your main organizational affiliation now? 



Name of organization 
57-62/ 



07 V and State 



(b) What is your position? 



Title 



63-64/ 



66/ 1 □ Yes 



2 □ No 



3 □ Not sure 



If Yes: Do you attribute the promotion to your research efforts? 

67/ 1 □ Yes 2 □ Partly 3 □ No 4 □ Don’t know 



(c) Did you receive a salary increase when you made this move? 



68/ 1 □ Yes 



2 □ No 



If Yes: Do you attribute the increase to your research? 
69/ 1 □ Yes 2 □ Partly 



GOTO QUESTION 62. 
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3 □ No 



4 □ Don’t know 



60. Have you been promoted since you started this research project? 



70 / 1 □ Yes 2 □ No 

If Yes: Do you attribute the promotion to your research efforts? 

71 / 1 □ Yes 2 □ Partly 3 □ No 4 □ Don't know 



6 1 . Have you received a salary increase? 

72 / 1 □ Yes 2 □ No 

If Yes: Do y ja attribute the increase to your research efforts? 

73 / 1 □ Yes 2 □ Partly 3 □ No 4 □ Don't know 

79 - 80/07 

1-6 

62. At present, how do you divide your ^professional time? 

Please give your best estimate of the percentage of time you spend on each activity. 

Per cent 



of time Activity 

7 - 8 / Curriculum or educational program development 

9-10/ Research (other than for a course or degree requirement) 

11-12/ SerWices (school surveys, consultation, test administration or scoring, workshops, etc.) 

13-14/ Working toward an advanced degree : 

15 / 1 □ M.A. 2 □ Ed.D. 3 □ Ph.D. 

16 - 17 / Teaching 

18 - 19 / Other (Please specify, e.g. Administration) 

100% 



63. At present, are you an advisor for doctoral dissertations? 



20/ 1 □ Yes 2 □ No 



If Yes: About how many students are you currently advising? 

Number 

21 - 22 / 



64. If you have had teaching experience: 



23 - 24 / (a) How many years have you taught in elementary or secondary school? 

(b) How many years have you taught college undergraduates? 

27 - 28 / (c) How many years have you taught graduate students? 

29 - 30 / (d) How many years have you done other types of teaching? 
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103 



" 6 - 

182 




65. Arc you a member of any national professional societies? 

31/ 1 □ Yes 2 □ No 

If Yes: Please name the two which are of greatest value to you. 
Use identifying words in full 

32-33/ 



Name of professional society 



34-35/ 



Name of professional society 



66. Within the last two years have you attended a meeting of an academic or professional society? 

36/ 1 □ Yes 2 □ No 



67. Have you ever been a field reader for the U.S. Office of Education? 
37/ 1 □ Yes 



2 □ No 



if Yes: Approxima.ely how many proposals have 

vou reviewed? 



Number 

38-39/ 



If No: Do you know anyone who is (or has been) a 
fi' Id reader? 

40/ 1 □ Yes 2 □ No 



68. 1 lave you ever been a consultant to the U.S. Office of Education? 

41/ 1 □ Yes 2 □ No 



69. How many research studies (articles, monographs, or books) have you published, and what was the date of 
your first publication? 

Number Type of publication 

Articles 



42-43/ 



44-45/ 



Monographs 



Books 



46-47/ 

Date of first publication 



Year 

48-49/ 



50/ 0 □ No research studies published. 



ERIC 



lO'f' 




7(J. Some researchers interested in education seek mainly to achieve recognition from behavioral scientists outside 
the field of education, while otlicrs arc primarily concerned with being recognized by researchers within 
education or by school practitioners. Please check the group whose judgement is most important to you 
personally. 

Please eheck only one 
51/ 1 □ Researchers within, education 

2 □ Researchers outside education 

3 □ School practitioners 
0 □ None of these 

71. Through a variety of sources, researchers get an overall impression of funding agencies. Is it your current 
imprc.ssion that the Regional Research Program is limited to a few areas of special interest, or docs it cover a 
broad range of interests in education? 

52/ 1 □ A few areas of special interest 
2 □ A broad range of interests 
0 □ 1 have no imprc.ssion. 

72. Do you think the USOE Regional Research Program tends to be orthodox or venturesome in their support of 
research? 

53/ 1 □ Orthodox; more likely to support established lines of research. 

2 □ Venturesome; willing to take risks in developing new lines of research on education. 

0 □ I liavc no opinion. 

73. As far as departures from the original proposal are concerned, is it your opinion that the Regional Research 
Program tends to be fairly strict or somewhat permissive? 

54/ 1 □ Fairly strict in expecting researchers to adhere closely to plans stated in proposals. 

2 □ Fairly permissive in allowing searchers to depart from their original plans. 

0 □ I have no opinion. 

74. In comparing the procedures that an applicant must follow when submitting a proposal to the Regional 
Research Program with those required by other agencies, would you say the Regional Research Program 
involves more, about the same, or somewhat less “red tape”? 

55/ 1 □ More “red tape” than most other funding agencies 

2 □ About the same amount of “red tape” 

3 □ Somewhat less “red tape” 

0 □ I have no opinion. 

75. Some researchers view the regulation requiring clearance of educational data-gathering instruments as a good 
idea, whereas others regard it as an unwarranted intrusion by USOE. What is your opinion, if any? 

56/ 1 □ It is a good idea. 

2 □ It is an unwarranted intrusion by USOE. 

0 □ I have no opinion. 

76. Have you ever submitted any data-gathering instruments to USOE for clearance? 

57/ 1 □ Yes 



49 - 




2 □ No 



77. As you may know, it is standard practice for the USOE to withhold a fixed percentage of a grant until the 
final report has been approved. Do you think this is a good idea? 

58/ 1 □ 1 agree with this practice. 

2 □ 1 disagree with it. 

0 □ 1 have no opinion. 

78. The USOE Regional Research Program encourages significant small scale educational research projects. Wliat 
do you think the ceiling on funds should be for small project research? 

S 

Appropnate ceiling 
59-61/ 

Please comment on your preference. 

62-63/ 



79. Finally, if you were to get a research grant for $10,000 or less, do you have any preference about the source of 
the grant? 

Check one 

64/ 1 □ 1 prefer a government agency. (Specify a particular one, if you wsh,) 



2 □ I prefer a private foundation . if you msh.) 



9 □ Oihex (Please specify) 



0 □ I have no preference about the source of the grant. 

If you do have a preference: Which of the following considerations influenced your choice? 
Check any that apply 

65/ 1 □ Absence of “red tape” in preparing the proposal 

2 □ Promptness of notification regarding support 

3 □ Method of proposal review 

4 □ Freedom to modify research plans 

5 □ Amount of project monitoring by funding agency 

6 □ Little likelihood of budgetary cutback 

7 □ Latitude in preparation of final report 

8 □ Copyright privileges 

9 □ OW\Qx (Please specify ) 



79-80/08 



EDUCATIONAL AND GENEIIAL BALi^CROUND 



1-6 



80. Please list the colleges or universities where you have earned a degree. 

Was degree 
in Education 





Institution 


State 


Name of 
Degree 


Year of 
Degree 


Miijor 

Field 




Yes 

(1) 


No 

(2) 


7-1 2/ 












18/ 


□ 


□ 








13/ 


14-15/ 


16-17/ 








1 9-24/ 












. 30/ 


□ 


□ 








25/ 


26-27/ 


28-29/ 








31-36/ 












. 42/ 


□ 


□ 








37/ 


38-39/ 


40-41/ 









81. Wh ^ is (was) the major advisor on your dissertation? 



45/ 0 □ I have not written a dissertation. 



Name of Advisor 
43-44/ 



82. Sex: 46/ i □ Male 2 □ Female 



83. Number of dependents, other than yourself 

Number 

47-48/ 



84. Year of birth 

49-50/ 



85. (a) Where did you live most of the time while you were growing up? 



51-52/ 

Cit}> State Country, if not U.S.A. 



(b) Where do you live now? 



53-54/ 

City State 



(c) How would you characterize where you grew up, and where you live now? 

Mark one in each column 





Lived 


Now live 


farm 


55/ 1 □ 


56/ 1 □ 


small town 


2 □ 


2 □ 


.moderate size town or city 


3 □ 


3 □ 


suburb of a large city 


4 □ 


4 □ 


large city 


- 5 □ 


5 □ 



,S6. \Vlia( is the hiuhcsi level of formal educalion reached by your spouse? Your father? Your mother? 

Mark one in each column 





Spouse 




Mother 


No spouse 


57/ 0 □ 


58/ 


59/ 


8lh grade or less 


1 □ 


1 □ 


1 □ 


Some higli scliool 


2 □ 


2 □ 


2 □ 


Completed liigli scliool 


3 □ 


3 □ 


3 □ 


Some college 


4 □ 


4 □ 


4 □ 


Graduated from college 


5 □ 


5 □ 


5 □ 


Some graduate school 


6 □ 


6 □ 


6 □ 


First professional degree 


7 □ 


7 □ 


7 □ 


Master’s Degree 


8 □ 


8 □ 


8 □ 


Ph.D.or Ed.D. 


9 □ 


9 □ 


9 □ 



Were your parents ever employed in educational work? 




Father 


60/ 


1 □ Yes 2 □ No 




Mother 


61/ 


1 □ Yes 2 □ No 




(Opfional) In what religion 


were you raised? What is your present religion? 






Mark one in each column 






Religion in 


Present 






which raised 


religion 


Catholic 




62/ 1 □ 


63/ 1 □ 


Jewish 




2 □ 


2 □ 


Protestant 




3 □ 


3 □ 


None 




0 □ 


0 □ 


Other 




9 □ 


9 □ 



(Piease specify) 



89 . 



Race: 



64/ 1 □ Caucasian 



2 □ Negro 



9 □ Other (Please specify) 




‘)0. In which of tlic following categories was yonr total income for 1968? What do you expect it to be for 1969? 



I%8 

65 / 1 □ I'iider S5,000 

2 □ $5,000 -$7,499 

3 □ $7,500 -$9,999 

4 □ $10,000- $14,999 

5 □ $15,000-519,999 

6 □ $20,000-524,999 

7 □ 525,000 - 529,999 

8 □ $30,000 or nrore 

79 - 80/09 



1969 

66/ 1 □ Under $5,000 

2 □ 55,000 -57,499 

3 □ 57,500 - 59,999 

4 □ $10,000-514,999 

5 □ $15,000-519,999 

6 □ 520,000-524,999 

7 □ 525,000-529,999 

8 n $30,000 or more 



We would appreciate having a copy of any paper you may have given at a convention 
or reprints of any research reports you may have written. Thank you for 
completing the questionnaire, and we wish you the best of luck in your future research. 



NO ENVELOPE OR POSTAGE NECESSARY FOR RETURNING THIS 
QUESTIONNAIRE. PLEASE STAPLE OR TAPE THE OPEN EDGE AND MAIL. 



1 
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QUESTIONNAIRE 
EOR EIELD READERS 



Supported by 

United States Office of Education 



Bureau of Applied Social Research 
COLUMBIA UNIVERSITY 
605 West 115th Street 
New Y )rk, New York 10025 



1. ^11 information is confidential. The results will be published only in 
statistical form. 

2. Most questions can be answered by a check-mark. ■ If you wish to explain 
your responses, jot your comments in the margin. 

3. When completed, please return the questionnaire in the enclosed envelope 



CAREER ACTIVITIES AND OPINIONS 
1-6/ (FR number) 

1 . Have you been engaged in research during any of the years listed below? 

PLEASE CHECK FOE EACH YEAR 



Year 




Engaged in 
research on 
education 
(1) 


Engaged in 
research other 
than on education 
(2) 


Not engaged 
in research 
CO) 


1969 


7/ 


[ ] 


[ ] 


[ ] 


1968 


8/ 


[ 1 


[ ] 


[ i 


1967 


91 


[ ] 


[ 1 


[ ] 


1966 


10/ 


[ ] 


[ ] 


[ ] 


1965 


11/ 


[ ] 


[ ] 


[ ] 


1964 


12/ 


[ ] 


[ ] 


[ ] 



2. Have you ever submitted any proposals to the U.5. Office of Education s 
Regional Research Program? 

13/ y 1 [ ] Yes 2 [ ] No 

IF YES: (a) How many have you subi.itted? 14/15 

Number 

(b) What have the outcomes been? 

Number 



Pending 16/17 

Funded 18/19 

Not funded 20/21 



3. Have you ever received a research grant from any of these sources 
CHECK ALL THAT APPLY 

22/ y 1 [ ] U.S. Office of Education 

2 [ ] Another federal agency 

3 [ ] State or municipal government 

4 [ ] Private foundation 

5 [ ] Commercial organization 

6 [ ] Your own institution 

9 [ 1 Other {Please specify) — 

0 [ 1 No research grant received 



201 
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4. (a) What is your major field or specialty? 

PLEASE CHECK ONLY ONE 



EDUCATION 

23/ 1 [ ] Administration 

2 [ ] Curriculum 

^ 3 [ ] Research and Statistics 

4 [ ] Teacher Training 
9 [ ] Other (Please speoify)_ 



PSYCHOLOGY 

24/ 1 L ] Developmental 

2 [ ] Guidance and Counseling 
^ 3 [ ] Learning 

4 [ ] Personality 

5 [ ] Testing and Measurement 
9 [ ] Other (Please speoify)_ 



SOCIAL SCIENCE 

25/ 1 [ ] History 

2 [ ] Political Science 
^ 3 [ ] Sociology 

9 [ ] Other (Please specify) 



26/ [ ] Other Field or Specialty (Please specify) 



(b) Within your major field, do you specialize in any of the sub-areas 
listed below? 

PLEASE CHECK ALL THAT APPLY 



27/ 1 [ ] Pre-school 

2 [ ] Elementary 
^ 3 [ ] Secondary 

4 [ ] College 

5 [ ] Graduate 

6 [ ] Adolescent 

7 [ ] Adult 

8 [ j Vocational 

9 [ ] Distributive 

X [ ] Other (Please specify) 



O 



02 



0 [ ] None 
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5. At present, how do you divide your professional time? 

PLEASE GIVE YOUR BEST ESTIMATE OF THE TIME YOU SPEND ON EACH ACTIVITY 
Per cent 

of time Activity 



28-29/ Curriculum or educational program development 

30-31/ Research 

32 _ 33 / ■ Services (school surveys; consultation; test 

administration; workshops) 

34-35/ Teaching 

35 _ 37 / Other (Please specify , e.g., administration) 



100 % 

6. Are you an advisor for doctoral dissertations? 38/ y 1[ ] Yes 2 [ ] No 
IF YES; (a) How many dissertations are you currently supervising? 

Number 39-40/ 

(b) Are any of these dissertations supported by the USOE 

Regional Research Program? 

41/ X 1 [ ] Yes 2 [ ) No 3 [ ] Don't know y 

7. Are you now under contract to the U.S. Office of Education as a field 

reader? 

42/ y 1 [ ] Yes 2 [ ] No 

8. In all, how many years have you been a field reader for the U.S. Office 

of Education? 

Number of Years 43-44/ 

9i Altogether, how many USOE proposals have you reviewed? 

Number 45-46/ 

10. Of these proposals, about how many were submitted to the Regional 
Research Program? 



Number 47-48/ 



20J 



-4- 



11. Thinking back, would you say that the quality of the proposals you have 
reviewed for the Regional Research Program has changed in the following 
respects ; 

(a) The criterion eduoational signifioan.oe is more, or less, frequently 
satisfied now than in the past? 

49/ y 1 [ ] More frequently satisfied 

2 [ ] No observable change 

3 [ ] Less frequently satisfied 
0 [ ] I have no impression. 

(b) The criterion soundness of research design is more, or less, 
frequently satisfied now than in the past? 

50/ y 1 [ ] More frequently satisfied 

2 [ ] No observable change 

3 [ ] Less frequently satisfied 
0 [ ] I have no impression. 

12. Do you think that a copy of the comments made by field readers should 
be sent routinely to each applicant? 

VLEASE CHECK ONLY ONE 

51/ y 1 [ ] Yes, these comments should be sent routinely to all 
applicants , 

2 [ ] Comments should be sent only to applicants who request them. 

3 [ ] Comments should be sent only to applicants whose proposals 

have been rejected. 

4 [ ] Comments should be sent only to applicants whose proposals 

have been funded. 

5 [ ] No, I don't think field reader comments should be sent to 

any applicants. 

0 [ ] I have no opinion. 

13. Should field readers be informed of the outcomes of the proposals they 
evaluate? 

52/ y 1 [ ] Yes 2 [ ] No 0 [ ] No opinion 

14. Should the final report be reviewed by a field reader who recommended 

the project for funding? . ' 




53/ y 



1 [ ] Yes 



2 [ ] No 



0 [ ] No opinion 
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IS. The present USOE Evaluation Form asks the reviewer to: 

(a) Provide an overall evaluation of the proposal; 

(b) Discuss the proposal as it relates to the reviewer's area of 

specialization; and 

(c) State to what extent the proposal satisfies four criteria: 

(1) educational significance 

(2) soundness of research design 

(3) adequacy of personnel and facilities 

(4) economic efficiency. 

Would you recommend any of the following changes in the Evaluation Form; 

CHECK ALL CHANGES YOU RECOMMEND 



For Regional^ 

Research Program For all USOE 
proposals proposals 



Eliminate (b) above 54/ 1 [ ] 

Provide a rating scale for each of the four 

criteria (e.g., educational significance). 2 [ ] 



56/ 1 [ ] 

0 

2 [ j 



Standardize the form by using checklists 

instead of essay-type answers. 3 [ J 

Separate the criterion "adequacy of personnel 

and facilities" into two criteria, "adequacy 

of personnel" and "adequacy of facilities." 4 [ ] 

Perforate the evaluation form so that comments 



recorded below the perforation could be sent 
to the applicant, while those above would be 
for USOE exclusively. ^ 1 

Eliminate one or more of the criteria listed 
in (c) above; 

(1) educational significance b [ ] 

(2) soundness of research design 7 [ ] 

(3) adequacy of personnel and facilities 8 [ ] 

(4) economic efficiency ^ t ] 

Add other criteria to (c) above; 

(1) significance beyond education 55/ 1 f ] 

(2) creativity of researcher 0 2 [ ] 

(3) suitability for replication 3 [ ] 

(4) other (Please specify) ^ f ^ 



3 [ ] 



4 [ J 



5 [ J 



6 L J 

7 [ 1 

8 [ ] 
9 [ ] 

57/ 1 [ 1 

0 2 [ ] 

3 [ ] 

9 f 1 
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20. In addition to being a field reader, have you ever been a consultant to 
USOE? 

72/ y 1 [ ] Yes 2 [ ] No 0 [ ] Cannot recall 

79-80/11 
1-6/ 

21. Have you ever reviewed proposals for a granting agency other than USOE? 

7/ y 1 [ ] Yes 2 [ ] No 0 [ ] Cannot recall 

IF YES: (a) For what type of agency? 

CHECK ALL THAT APPLY 

8/ 1 [ ] Another federal agency 

2 [ ] State or municipal government 

X 3 [ ] Private foundation 

4 [ ] Professional association 

y 5 [ ] Educational consortium 

6 [ ] Your own institution 

9 [ ] Other (Please specify) 

(b) Do you think that the quality of proposals submitted to 
USOE is better, about the same, or not as good as other 
proposals you have reviewed? 

9/ 1 [ ] Proposals submitted to USOE are better 

X 2 [ ] About the same 

3 [ ] Not as good as others 

^ 0 [ ] Not comparable 

22. Have you ever been an editorial consultant for a scientific journal? 

10/ y 1 [ ] Yes 2 [ ] No 0 [ ] Cannot recall 

23. Are you a member of any national professional societies? 

11/ y 1 [ ] Yes 2 [ ] No 

IF YES; PLEASE NAME THE TWO WHICH ARE OF GREATEST VALUE TO YOU. 

Use identifying words in full. 



12-14/ 


1. 


15-17/ 


2. 



- 8 - 



24. At present, are you an officer of an academic or professional society? 

18/ y 1 [ ] Ves 2 [ ] No 

IF YES: 

Name of society in full 19-21/ 

25. Within the last two years have you attended a meeting of an academic or 
professional society? 

22/ y 1 [ ] Yes 2 [ ] No 

26. How many r'eseardh studies (articles, monographs, or books) have you 
published, and what was the date of your first publication? 



Number Type of Publication 

I'h-lAl Articles 

2^-2^! Monographs 

2 7-28/ Books 

29-30/ Date of first publication 

Year 

31/ X 0 [ ] No research studies published 



27. Would you describe your research interest as mainly basic or applied? 

32/ y 1 [ ] Basic 

2 [ ] Applied 

9 [ ] Other (Please specify) 

28. Some researchers interested in education seek mainly to achieve recog- 
nition from behavioral scientists outside the field of education, while 
others are primarily concerned with being recognized by researchers 
within education or by school practitioners. Please check the group 
whose judgment is most important to you personally. 

PLEASE CHECK ONLY ONE 

1>1>I y 1 [ ] Researchers within education 

2 [ ] Researchers outside education 

3 [ ] School practitioners 

0 [ ] None of these 




-9- 



29. Through a variety of sources, researchers get an overall impression of 
funding agencies. Is it your current impression that the Regional Research 
Program is limited to a few areas of special interest, or does it cover a 
broad range of interests in education? 

34/ y 1 [ ] A few areas of special interest 
2 [ ] A broad range of interests 
0 [ ] I have no impression. 

30. Do you think that the USOE Regional Research Program tends to be orthodox 
or venturesome in its support of research? 

35/ y 1 [ ] Orthodox; more likely to support established lines of 
research . 

2 [ ] Venturesome; willing to take risks in developing new lines 
of research on education. 

0 [ ] I have no opinion. 

31. As far as departures from the original proposal are concerned, is it your 
opinion that the Regional Research Program tends to be fairly strict or 
somewhat permissive? 

36/ y 1 [ ] Fairly strict in expecting researchers to adhere closely to 
plans stated in proposals. 

2 [ ] Fairly permissive in allowing researchers to depart from 
their original plans. 

0 [ ] I have no opinion. 

32. Do you think that the Regional Research Program should encourage the 
researcher to investigate certain definite areas (e.g., reading), or 
should it encourage him to develop his own area of interest within the 
field of education? 

37/ y 1 [ ] Encourage the researcher to investigate certain definite 
areas . 

2 [ j Encourage the researcher to develop his own interest . 

3 [ ] I have no opinion. 



33. In comparing procedures that an applicant must follow when submitting a 
prv posal to the Regional Research Program with those required by other 
agencies, would you say that the Regional Research Program involves more, 
about the same, or somewhat less "red tape"? 



38/ y 



1 [ ] More "red tape" than most other funding agencies 

2 [ ] About the same amount of "red tape" 

3 [ ] Somewhat less "red tape" 

0 [ ] I have no opinion. 




20d 
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34. Some researchers view the regulation requiring clearance of educational 
data-gathering instruments as a good idea, whereas others regard it as 
an unwarranted intrusion by USOE. What is your opinion, if any? 

39/ y 1 [] It is a good idea. 

2 [] It is an unwarranted intrusion by USOE. 

0 [ ] I have no opinion. 

35. Have you ever submitted any data-gathering instruments to USOE for 
clearance? 

40/ y 1 [ ] Yes 2 [ ] No 

36. As you may know, it is standard practice for the USOE to withhold a fixed 
percentage of a grant until the final report has been approved. Do you 
think this is a good idea? 

41/ y 1 [ ] I agree with this practice. 

2 f 1 I disagree with the practice. 

0 i ] I have no opinion. 

37. A stated goal of the Regional Research Program is; 

"To encourage small colleges to undertake research programs 
so that students may benefit from having professors who are 
engaged in educational research activities." 

Do you think that this goal should be emphasized more, about the same, or 
less than it is now? 

42/ y 1 [ ] More 

2 [ ] About the same 

3 [ ] Less 

0 [ ] I have no opinion 



38. The present ceiling on funds for proposals submitted to the Regional 
Research Program is $10,000. What do you think the ceiling on funds 
should be? 

* 43^457 

PLEASE COMMENT ON YOUR PREFERENCE 
46-AH 




Pn 



U .J 



yy 
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39. Listed below are some possible advantages of being a field reader for the 
Regional Research Program. Indicate those that apply to you personally. 

CHECK ALL THAT APPLY 

48/ y 1 [ ] Acquisition of 'intelligence' about USOE granting practices 

2 [ ] Contact with educational researchers from other institutions 

3 [ ] Contact with USOE officials 

4 [ ] Exposure to new research ideas 

5 [ ] Intellectual stimulation 

6 [ ] Opportunity to contribute ideas to young researchers 

7 [ ] Opportunity to influence research on education 

8 [ ] Professional prestige 

9 [ ] Other (Ptease specify) 



Please use this space for additional comments, either positive or negative, 
about the Regional Research Program--for example, goals of the Program, method 
of evaluating proposals, selection of field readers, remuneration to field 
readers, or any other aspect of the Program you wish to discuss. 

49-51/ 

yyy 



THANK YOU FOR COMPLETING THE QUESTIONNAIRE 
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INTRODUCTION 



Tliis codebook is based on data obtained from four sources; 

Applicant Questionnaire 
Field Reader Questionnaire 
Applicant Proposal 
Proposal Evaluation. 

Applicant Questionnaire . In July, 1969, two versions of this 
questionnaire were mailed to all applicants submitting proposals to the 
USOE Small-Project Grants Program during Fiscal Year 1968, One was sent 
to applicants who were funded (N=281) , and the other to those who were not 
funded (N=561). Six hundred sixty-five questionnaires were returned and 
processed (89 per cent of the qeustionnaires sent to funded applicants and 
T6 per cent of those sent to not funded applicants) . Section I of the 
codebook presents the data from these questionnaires. 

Field Reader Questionnaire . In March, 1970, a questionnaire was 
mailed to 498 field readers, the evaluators under contract to USOE, who 
reviewed the proposals submitted during Fiscal Year 1968. Four hundred 
twenty-three questionnaires were returned and processed (85 per cent) , 

Section II presents the data from these questionnaires. 

Applicant Proposal . Factual material was abstracted from the 
proposals submitted by each applicant in the questionnaire sample. Data 
from the 665 proposals for the applicants completing the questionnaire are 
p?;esented in Section III, and those from the 177 proposals for the applicants 
not responding to the questionnaire are presented in Section IV. 

ITie background data for the 177 non-respondents, appearing in 
Section VI of the codebook, was extracted from their proposals. 

Proposal Evaluation . The field reader recommendations and ratings 
on the major criteria for evaluating each proposal are presented in Section 

V. 



O 







STANDARD IDENTIFICATION 



I. Applicant Questionnaire 



A. Fiscal Year Column 1/ 

(July 1 , 1957 - June 30, 1968) 



8 Respondent 



B. USOE Regional Office 



Coluni]! 



2 / 



1 Boston 

2 New York 

3 Charlottesville 

4 Atlanta 

5 Chicago 

6 Kansas City 

7 Dallas 

8 Denver 

9 San Francisco 



C. Applicant Number Columns 3-5/ 

D. Disposition Column 6/ 

1 Funded 

2 Not funded 



I. Field Reader Questionnaire 

A. Area Location served by 
USOE Regional Office 



Columns 1-2/ 

01 Boston 

02 New York 

03 Charlottesville 

04 Atlanta 

05 Chicago 

06 Kansas City 

07 Dallas 

08 Denver 

09 San Francisco 

10 Unassigned - Canada 



B. 



Accession Number 



* 



Columns 3-6/ 



Source: Office of Education, Bureau of Research, Field Reader 

catalogs. The tv/o leading zeros of each number have been omitted. 




III. Proposal 



Idonlifications apply to: 

1. Proposal Content (Respondent Section) 

2. Proposal Content (Non-Respondent Section) 

3. Proposal Evaluation 

4. Non-Respondent Background 

A. Case Type Column 1/ 

5 Non-respondent 
8 Resporlent 



3. USOE Regional Office 
(ERIC Code) 



Column 2/ 

A 

B 

C 

D 

E 

F 

G 

H 

I 



Boston 

New York 

Charlottesville 

Atlanta 

Chicago 

Kansas City 

Dallas 

Denver 

San Francisco 



C. Applicant Number Columns 3-5/ 

D. Disposition Column 6/ 

1 Funded 

2 Not funded 



IV. Institutions 

A. State Columns 1-2/ 

(Listing in Appendix C) 

B. USOE Number Columns 3-6/ 

(Explicit identification 

in Nash college file — 

BASR #B1050) 
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V 



Decks 



A. Source of Data 



B. Sequence Number 



O 




Column 79 / 

0 Applicant 

questionnaire 

1 Field Reader 

questionnaire 

2 Proposal 

a. Content 
(Respondent Section) 

b. Content (Non- 
Respondent Section) 

c. Non- Respondent 
Background 

3 Evaluation 

4 Institution 



Column 80/ 

1-9 Applicant 

questionnaire 

1- 4 Field Reader 

questionnaire 

2- 5 Proposal content 
1 Non-Resnondent 

backgrcpnd 
1-n Evaluation 

(n varies from 
one to twelve) 
1 Institution 
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NOTES 



Multiple-Punched Columns . Originally, many columns were multiple- 
punched, For computer processing, the punches have been transferred to 
sop.araco columns. Each numeric punch, one through nine, has been converted 
to a one (1) in the new column, A zero punch (0) in the new column indicates 
that the response category was not checked by the respondent. Each zero 
(0) , X (11 punch), or Y (12 punch) has been transferred as a one (1), but the 
absence of the punch has not been assigned a value; the column has been left 
blank ■ — a reject (R). The frequencies for the zeros and rejects in the new 
columns do not appear in the codebook. 

Column Tota ls, Miere column totals appear in the codebook, the 
original colurmi contained multiple punches. 



ERRATA 



I. Applicant Questionnaire 

Not 

Funded Funded Total 



Iteni 2. 



II 


7/ 


1 


USOE 


60 


92 


152 




8/ 


1 


Another government 














agency 


51 


104 


155 


1 tern 


6, 












V 


49/ 


X 


DNA: Should read 












R 


DNA: 








Item 


19. 


IF YES: (a) With whom did you 


discuss 


the proposal 




VI 


16/ 


9 


Other (e.g,, regional 














intern) 


- 


11 


11 


Item 


48 „ 


C45) 










IV 


13/ 


1 


I have not recommended 














any changes 


107 


98 


205 


Item 


49 „ 


(46) 










IV 


20/ 


1 


Interdepartmental faculty- 














student seminar 


23 


32 


55 


Item 


60, 


(57) 










VII 


70/ 


1 


Yes 


47 


89 


136 






X 


DNA: Moved to another 














organization 


72 


119 


191 


Item 


39. 


(34) 










VII 


76/ 


3 


Not engaged in research 


35 




35 






X 


DNA: RRP project not 














completed 


130 


- 


130 






vr 

A 


DNA; Not engaged in 














research 


- 


146 


146 



O 

ERIC 

MilHllilBIffTlTLiU 




V, Proposal Evaluation 



Field 

Reader 



Item 12 . 
80/ 



O 

ERIC 



By In-house reviewer : 

1 One Should read 
7 One 



In-house 



424 



21 






APPLICANT question; IaI RE 









Not 








Funded 


Funded 


Total 


Positioii on 


project 








V 19/ 1 


Project Director 


152 


194 


346 


2 


Principal Investigator 


83 


158 


241 


3 


Consultant 


-- 


3 


3 


4 


Research Assistant 


3 


1 


4 


5 


Co-director 


8 


31 


39 


6 


Assistant Director 


4 


3 


7 


7 


Initiator 




7 


7 


8 


Co-initiator 


1 




1 


9 


Research Associate 


__ 


1 


1 


0 


Contract Officer 


-- 


2 


2 


Y 


No answer 




14 


14 



1 . In the 


last five years have you been 


engaged in any 


research 


projects 


19'j8: 


V 7/ 1 


Education 


138 


228 


366 


2 


Another field 


20 


44 


64 


3 


Education and another field 


33 


47 


80 


0 


Not engaged in research 


60 


93 


153 


Y 


No activity specified 


-- 


2 


2 



1967 
V 8/ 


1 


Education 


114 


214 


328 




2 


Another field 


29 


50 


79 




3 


Eci oation and another field 


32 


40 


72 




0 


Not engaged in research 


76 


108 


184 




Y 


No activity specified 


-- 


2 


2 



1966 
V 9/ 


1 


Education 


94 


170 


264 




2 


Another field 


41 


59 


100 




3 


Education and another field 


21 


35 


56 




0 


Not engaged in research 


95 


148 


243 




Y 


No activity specified 


-- 


2 


2 



1965: 










V 10/ 1 


r’ u.,ion 


70 


130 


200 


2 


Another field 


43 


67 


110 


3 


Education and another field 


16 


20 


36 


0 


Not engaged in research 


122 


195 


317 


Y 


No activity specified 


__ 


2 


2 




221 







Funded 


Funded 


Total 


1964: 










V 11/ 1 


Education 


59 


90 


149 


2 


Another field 


39 


65 


104 


3 


Education and another field 


19 


17 


36 


0 


Not engaged in research 


134 


240 


374 


Y 


No activity specified 


- 


2 


2 



2. Have you ever received a research grant from any of the following 
sources ? 



7/ 


1 


USOE 


60 


93 


153 


8/ 


1 


Another government agency 


51 


105 


156 


9/ 


1 


Private foundation 


41 


65 


106 


10/ 


1 


Employing institution 


86 


182 


268 


11/ 


1 


Commercial organization (e.g. 


,IBM) 10 


9 


19 


12/ 


1 


Educational organization (e.g 












Phi Delta Kappa, AAUIV) 


8 


11 


19 


13/ 


1 


No grant received 


108 


141 


249 


14/ 


1 


No answer 


3 


6 


9 








(367) 


(612) 


(97‘9) 



3. What cooperating institution was listed on the title page of your 
proposal ? 

V 13-18/ See Nash college file (BASR #81050) for explicit institu- 
tional ID. First two digits of Nash college file identify 
state in which institution located. See Appendix C for 
listing of states . 



Type of institution: 



V 22/ 1 


College or university 


222 


338 


560 


2 


State Department of Education 


4 


5 


9 


3 


School system 


18 


48 


66 


4 


Private agency 


7 


17 


24 


9 


Individual or other (e.g., 
educational association) 


__ 


6 


6 



(a) If College or University: 








Subdivision : 








V 24/ 1 


Education 


100 


164 


264 


3 


Research institute or bureau 


12 


12 


24 


5 


Both education and research 










institute 


8 


6 


14 



3(a) (Continued) 

Liberal Arts Subdivision: 





Not 




Funded 


Funded 


Total 



V 



Cb) 

V 



23/ 


1 


Psychology 


26 


20 


46 




2 


Sociology 


8 


12 


20 




3 


Other social science 


16 


20 


36 




4 


Math, physical or biological 












science 


9 


21 


30 




5 


English and language arts 


12 


25 


37 




6 


Music and art 


4 


14 


18 




7 


Liberal arts - NEC 


4 




4 




Y 


Department not specified 


2 


3 


5 


Other Subdivision: 








21/ 


3 


Professional school 


2 


2 


4 




4 


Engineering; applied science 


7 


4 


11 




5 


Library and languages 


5 


1 


6 




6 


^^usic and art 


3 


7 


10 




7 


Administrative officer 


12 


27 


39 




8 


Vocational and applied arts 


6 


5 


11 




9 


Audio-visual 


1 


1 


2 




0 


Physical education 


5 


7 


12 


24/ 


Y 


Subdivision not specified 




1 


1 




X 


DNA: Not in higher education 


29 


75 


104 








(271) 


(427) 


(698) 



Enrollment 








25/ 1 


Undergraduate 


28 


57 


85 


2 


Graduate 


47 


62 


109 


3 


Joint undergraduate/graduate 


111 


179 


290 


Y 


Enrollment not specified 


20 


19 


39 


X 


DNAi Not in higher education 


45 


97 


142 




22J 



4. 


At the time you submitted this proposal, 
v^hat was your employment status? 


Funded 


Not 

Funded 


Total 


V 


26/ 1 Employed £u] 1-time 


164 


275 


439 




2 Employed part-time 


5 


12 


17 




3 Gi-aduate student fuil-time 


30 


30 


60 




4 Graduate student part-time 


4 


5 


9 




5 Employed £-t; student £-t 


1 


3 


4 




6 Employed £-t; student p-t 


29 


53 


82 




7 Employed p-t; student f-t 


5 


12 


17 




8 Employed p-t; student p-t 
20/ 9 Other (e.g.., emeritus, post- 


7 


22 


29 


(a) 


doctoral fellow) 

IF EMPLOYED: 


6 


2 


8 


V 


27/ 1 Cooperating institution 


196 


340 


536 




2 Elsewhere 


20 


41 


61 




Y No answer 


- 


1 


1 


(b) 


X DNA: Not employed 

Beginning date of employment: 


35 


32 


67 


V 


28-29/ 1968 


7 


7 


14 




1967 


50 


51 


101 




1966 


36 


74 


no 




1965 


21 


50 


71 




1964 


24 


19 


43 




1962-63 


22 


31 


53 




1958-61 


29 


41 


70 




1950-57 


13 


47 


60 




Prior to 1950 (1929-1949) 


10 


21 


31 




YY No answer 


4 


41 


45 




XX DNA: Not employed 


35 


32 


67 




22'1 



Not 

Funded Funded Total 

(c) Position: (See Appendix A for refined 

classification of position in V 30-31/ and 
second named position in V 69-70/) 



V 



30/ 0 Research Director 

1 Faculty _ 





(F) 


(NF) 


Prof. 


43 


66 


Assoc . 


46 


67 


Ass ' t , 


54 


89 


Other 


10 


17 



16 

153 



28 44 

239 392 



2 


Student Assistant or Fellow 


5 


17 


22 


3 


Administrative Officer 


11 


30 


41 


4 


Program Director 


10 


22 


32 


5 


Counselor or Consultant 


7 


17 


24 


7 


Te acher 


11 


22 


33 


8 


School Administrator 


2 


6 


8 


Y 


No answer 


1 


1 


2 


X 


DNA: Not employed 


35 


32 


67 



(a) IF GRADUATE STUDENT: 



V 


32/ 1 


Cooperating institution 


51 


86 


137 




2 


Elsewhere 


25 


38 


63 




Y 


No answer 


- 


1 


1 




X 


DNA: Not student 


175 


289 


464 



(b) Year of matriculation: (Month recorded in V 33-34/) 



V 35-36/ 1967-68 

1966 
1965 
1964 
1960-63 

Prior to 1960 (1951-59) 
YY No answer 
XX DNA: Not student 



9 

10 

17 

7 

5 

2 

26 

175 



10 

20 

8 

11 

7 

7 

62 

289 



19 

30 

25 

18 

12 

9 

88 

464 




22j 



Not 

Funded Funded Total 

5(a) At the time you submitted your pro- 
posal, what was your major field or 
specialty? 

Education : 



37/ 1 


Administration 


31 


47 


78 


2 


Curriculum 


15 


40 


55 


3 


Research and statistics 


11 


23 


34 


4 


Teacher training 


57 


85 


142 


5 


Instructional technology 


5 


6 


11 


6 


Special education (e.g., adult, 
business) 


7 


21 


28 


7 


Teacher - below college lev^ 1 


1 


12 


13 



Psychology: 








38/ 1 


Developmental 


11 


9 


20 


2 


Guidance and counseling 


19 


29 


48 


3 


Learning 


13 


10 


23 


4 


Personality 


4 


5 


9 


5 


Testing and measurement 


3 


4 


7 


6 


Educational 


7 


7 


14 


7 


Clinical 


3 


4 


7 


9 


Other (e.g., social, experimental) 


5 


10 


15 



Social 


Scien ce : 








39/ 1 


History 


3 


9 


12 


2 


Political science 


5 


5 


10 


3 


Sociology 


10 


15 


25 


9 


Other (e.g., anthropology. 










economics) 


8 


19 


27 



Other : 


field or specialty: 








39/ 4 


Math; physical, biological 


12 


22 


34 


5 


sciences 

English and language arts 


15 


18 


33 


6 


Music and art 


4 


11 


15 


X 


Professions (e.g., medicine, 
nursing, law) 


2 


3 


5 




22b 



Not 

Funded Funded Total 

5(b) Within your major field, were you 
specializing in one or more of the 
sub-areas listed below? 



67/ 


1 


Pre-school 


17 


28 


45 


68/ 


1 


Elementary 


52 


101 


153 


69/ 


1 


Secondary 


62 


136 


198 


70/ 


1 


College 


81 


153 


234 


71/ 


1 


Graduate 


33 


78 


111 


72/ 


1 


Adolescent 


9 


32 


41 


73/ 


1 


Adult 


16 


40 


56 


74/ 


1 


Vocational 


20 


44 


64 


75/ 


1 


None 


75 


77 


152 


76/ 


1 


No answer 


14 


22 


36 



(379) r711) (1090) 



In what activities were you engaged when you submitted the 
proposal to USOE? 

Per cent time Curriculum or Program Development: 

41-42/ 



01-20 


27 


80 


107 


21-40 


15 


30 


45 


41-60 


9 


20 


29 


61-80 


5 


6 


11 


81-100 


1 


5 


6 


RR No time this area 


190 


261 


451 


YY No answer 


3 


12 


15 


XX Retired 


1 


-- 


1 



Per cent time Research: 
43-44/ 



01-20 


45 


93 


138 


21-40 


45 


63 


108 


41-60 


26 


30 


56 


61-80 


3 


16 


19 


81-100 


8 


8 


16 


RR No time this area 


117 


192 


309 


YY No answer 


6 


12 


18 


XX Retired 


1 


-- 


1 




22 / 



r 



6. (Continued) 

Per cent time Services: 

V 45-46/ 01-20 

21-40 

41-60 

61-80 

81-100 

RR No time this area 
YY No answer 
XX Retired 



Not 

Funded Funded Total 



32 

9 

6 

3 

195 

5 

1 



55 

21 

5 

4 

3 

314 

12 



87 

30 

11 

7 

3 

509 

17 

1 



Per cent time Working toward Degree; 



V 47-48/ 



01-20 

21-40 

41-60 



61-80 

81-100 

RR No time this area 
YY No answer 
XX Retired 



15 

10 

13 

8 

25 

174 

5 

1 



32 

17 

27 

3 

29 

289 

12 



47 

27 

40 

16 

54 

463 

17 

1 



IF WORKING TOWARD DEGREE : 

V 49/ 1 liaster's 

2 Ed.D. 

3 Ph.D. 

X DNA; Not working toward 
degree 



1 

28 

47 

175 



8 

43 

74 

289 



9 

71 

121 

464 



Per cent time Teaching: 



V 50-51/ 






01-20 

21-40 

41-60 

61-80 

81-100 

RR No time this 
YY No answer 
XX Retired 



area 



17 


31 


48 


25 


57 


82 


60 


88 


148 


38 


64 


102 


28 


42 


70 


75 


120 


195 


7 


12 


19 


1 


- 


1 
















Not 






(Continued) 




Funded 


Funded 


Total 


6 . 












Per cent time 


Administration and Other: 








V 


52-53/ 


01-20 


31 


54 


85 






21-40 


18 


39 


57 






41-60 


25 


32 


57 






61-80 


7 


14 


21 






81-100 


8 


20 


28 






RR No time this area 


157 


243 


400 






YY No answer 


4 


12 


16 






XX Retired 


1 


~ - 


1 



7. How did you first learn of the USOE Regional Research Program? 

V 71/1 Oral presentation by USOE 

official or USOE written 







materials 


24 


43 


67 


72/ 


1 


Personal contact with USOE 












official 


40 


36 


76 


73/ 


1 


CORD 


1 


9 


10 


74/ 


1 


Colleague; supervisor; dean 


156 


268 


424 


75/ 


1 


Other source (e.g., AERA 












newsletter) 


12 


31 


43 


76/ 


1 


Cannot recall 


26 


38 


64 


77/ 


1 


No answer 


1 


6 


7 








(260) 


(431) 


(691) 



8. How did you plan to conduct the research described in the proposal? 



1 


Staff member in a research unit 


43 


58 


101 


2 


Facilitated by a research unit. 










but not as staff member 


11 


26 


37 


3 


Independent of a research unit 


192 


316 


508 


Y 


No answer 


5 


14 


19 



9. Was this project the first one you directed or co-directed? 



V 


56/ 1 


Yes 


146 


218 


364 




2 


No 


99 


186 


285 




Y 


No answer 


5 


10 


15 




X 


DNA: Not director or co-director 


1 


— 


1 



22U 













Not 












Funded 


Funded 


Total 


iO. 


Did 


you 


intend the proposed research 










for 


a doctoral dissertation? 








V 


57/ 


1 


Yes 


72 


114 


186 






2 


No 


178 


296 


474 






Y 


No answer 


1 


4 


5 




IF YES: 


IVhich degree? 








V 


58/ 


2 


Ed.D. 


27 


44 


71 






3 


Ph.D. 


45 


69 


114 






Y 


No answer 


1 


5 


6 






X 


DNA: Not for dissertation 


178 


296 


474 



11. Thinking back, would you say you had some well-defined research 
plans before you thought of applying to the Regional Research 
Program? 



V 59/ 1 


Yes, well-defined 


215 


329 


544 


2 


No, had general idea 


28 


65 


93 


3 


No, developed later 


5 


16 


21 


Y 


No answer 


3 


4 


7 



12 . Had you 
agency? 


previously submitted 


a similar proposal to 


a funding 




V 60/ 1 


Yes 


40 


71 


111 


2 


No 


210 


340 


550 


Y 


No answer 


1 


3 


4 



IF YES: 




(a) Type of agency: 












(First named 63/; second named 62/; 


third named 


61/.) 


V 61,62, 


1 


U.S. Office of Education 


24 


30 


54 


or 63/ 


2 


Other federal agency 


12 


17 


29 




3 


State agency 


1 


8 


9 




4 


Private foundation 


2 


20 


22 




5 


Other - NEC 


1 


2 


3 




Y 


No answer 


2 


4 


6 




X 


DNA: Not previously submitted 


210 


340 


550 








(252) 


(421) 


(673) 




230 



12. (Continued) 

(b) Did you have to rewrite the 
before submitting it to the 
Research Progra:,;? 



Funded 


Not 

Funded 


Total 


proposal 

Regional 







V 


64/ 


1 


Yes 


30 


48 


78 






2 


No 


9 


23 


32 






Y 


No answer 


2 


3 


5 






X 


DNA: Not previously submitted 


210 


340 


550 




IF YES: 


Modifications made: 








V 


65/ 


1 


Reduced to $10,000 


15 


21 


36 






2 


Expanded scope to $10,000 


1 


1 


2 






3 


More focus on education 


4 


12 


16 






4 


Edited 


2 


6 


8 






5 


Reduced and focused more on 














education 


4 


3 


7 






6 


Reduced scope and edited 


3 


- 


3 






7 


Expanded and focused more on 














education 


- 


1 


1 






9 


Reduced; focused more on 














education; edited 


- 


1 


1 






Y 


Changes not specified 


3 


6 


9 






X 


DNA: No rewrite required or 














not previously submitted 


219 


363 


582 



13. Was the proposal written to extend research in the same specialty 
in which you had been working, or to begin research in another 
specialty? 



V 



V 



66 / 



69-70/ 



1 Extend research in same 



specialty 

Begin research in another 


185 


309 


494 


specialty 


54 


91 


145 


No answer 


12 


14 


26 


Second position (See Q 4c) 


14 


20 


34 



231 



Not 

Funded Funded Total 

14. l\Tien you were preparing the proposal, 
did you have access to any of the 
following resources at your institution? 

Available resources: 



16/ 


1 


'Information bank' 


106 


143 


249 


17/ 


1 


Sample applications 


95 


177 


272 


18/ 


1 


'Resource person' 


179 


268 


447 


19/ 


1 


Sample proposals 


113 


168 


281 


20/ 


1 


ERIC materials 


97 


108 


205 


21/ 


1 


USOE "Guidelines ..." 


221 


323 


544 


22/ 


1 


IfSOE "Winning a Research Bid..." 


26 


41 


67 


23/ 


1 


No available resources 


3 


28 


31 


24/ 


1 


No answer 


4 

(844) 


9 

(1265) 


13 

(2109) 



Resources used: 



26/ 


1 


'Informatirn bank' 


49 


91 


140 


27/ 


1 


Sample applications 


61 


142 


203 


28/ 


1 


'Resource person' 


158 


239 


397 


29/ 


1 


Sample proposals 


84 


144 


228 


30/ 


1 


ERIC materials 


38 


61 


99 


31/ 


1 


USOE "Guidelines ..." 


212 


304 


516 


32/ 


1 


USOE "Winning a Research Bid..." 


14 


31 


45 


33/ 


1 


No resourced used 


10 


45 


55 


34/ 


1 


No answer 


4 


9 


13 








(630) 


(1066) 


(1696) 



15, iVhen you submitted this proposal, did you personally know anyone 
at your institution who was engaged in research that was being 
funded by an outside agency? 



VI 


7/ 1 


Yes 


1% 


290 


476 




2 


No 


63 


122 


185 




Y 


No answer 


2 


2 


4 




IF YES: 


Was any of this researc’: 


supported by USOE? 






VI 


8/ 1 


Yes 


118 


190 


308 




2 


No 


40 


52 


92 




3 


Don't know 


27 


46 


74 




Y 


No answer 


3 


4 


7 




X 


DNA: Didn't know anyone 


63 


122 


185 



P Q :> 

i-- Ifw 



o 



Not 

Funded Funded Total 

16, Does your institution have a policy 

th'at requires one or more staff members 
to critically review a proposal prior 
to submi ion? 



VI 


9/ 1 


Yes 


96 


207 


303 




2 


No 


120 


150 


270 




3 


Don't know 


34 


53 


87 




Y 


No answer 


1 


4 


5 



17. 


Apart from 


institutional requirements, 


did you ask 


anyone to 






critically 


read your proposal? 








VI 


10/ 1 Yes 




192 


349 


541 




2 No 




55 


64 


119 




Y No 


answer 


4 


1 


5 



18. 


IF ANYONE 


; CRITICALLY READ YOUR PROPOSAL: 










(a) iVhat 


was 


; his position? 








II 


36/ 


1 


Researcher, education 


59 


144 


173 




37/ 


1 


Researcher, behavioral science 


38 


74 


112 




38/ 


1 


Researcher, another discipline 


14 


48 


62 




39/ 


1 


Dissertation adviser 


49 


69 


118 




40/ 


1 


Colleague or peer 


111 


188 


299 




41/ 


1 


Administrator 


59 


132 


191 




42/ 


1 


Research coordinator 


47 


111 


158 




43/ 


1 


Bureau director 


18 


35 


53 




44/ 


1 


No internal reviewer 


17 


27 


44 










(412) 


(798) 


(1210) 




Position outside institution; 










48/ 


1 


Researcher, education 


20 


52 


72 




49/ 


1 


Researcher, behavioral science 


18 


25 


43 




50/ 


1 


Researcher, another discipline 


5 


16 


21 




51/ 


1 


Dissertation adviser 


10 


22 


32 




52/ 


1 


Colleague or peer 


18 


50 


68 




53/ 


1 


Administrator 


7 


16 


23 




54/ 


1 


Research coordinator 


6 


15 


21 




55/ 


1 


Bureau director 


9 


8 


17 




56/ 


1 


No outside reviewer 


144 


251 


395 




46,58/ 


1 


No answer 


15 


9 


24 




45,57/ 


1 


DNA: Proposal not critically 














read 


26 


35 


61 










(278) 


(499) 


(777) 



lU 



p 



ERIC 



18. 



II 



VI 



VI 



VI 



(Continued) 

(b) As a result of these reviews, did you 



Funded 



Not 

Funded 



Total 



make 


any of the following changes? 








60/ 


1 


Research design 


70 


134 


204 


61/ 


1 


Review of literature 


26 


^1 


83 


62/ 


1 


Educational significance 


62 


140 


202 


63/ 


1 


Application of results 


59 


125 


184 


64/ 


1 


Arranged for consultation 


9 


32 


41 


65/ 


1 


Description of personnel 


9 


35 


44 


69/ 


1 


Description of facilities 


15 


38 


53 


10 / 


1 


Bibliography 


16 


23 


39 


71/ 


1 


Editing and style 


95 


113 


208 


72/ 


1 


Budget 


79 


156 


235 


11 / 


1 


Time schedule 


31 


55 


86 


74/ 


1 


Other (e.g., modes of analysis. 












increased scope) 


- 


10 


10 


75/ 


1 


None of these changes 


24 


46 


70 


67,77/ 


1 


No answer 


22 


20 


42 


66,76/ 


1 


DNA: Proposal not critically 












read 


26 


35 


61 








(542) 


(1019) 


(1562) 



19. 



Before you officially submitted the proposal, did you informally 
discuss it with anyone from the USOE Regional Office or from 
Washington ? 



15/ 



1 Yes 

2 No 

Y No answer 



115 

134 

2 



]53 

258 

3 



268 

392 

5 



IF YES ; (a) With whom did you discuss the proposal? 



16/ 



1 

2 

4 



9 

Y 

X 



17/ 



1 

2 

Y 

X 



Regional Director 




83 


99 


182 


Staff member, Washington 
Regional Director and 




23 


32 


55 


Washington 




9 


9 


18 


Other (e.g., regional intern) 


11 


11 


11 


No answer 




2 


5 


7 


DNA: Not discussed with 


USOE 


134 


258 


392 


discussion helpful? 


Yes 




103 


85 


188 


No 




4 


48 


52 


No answer 




10 


23 


33 


DNA: Not discussed with 


USOE 


134 


258 


392 



234 






' 



Funded 



Nol: 

Funded 



20. As far as preparing the proposal, how 
would you characterize the USOE's help? 



Total 



VI 


18/ 


1 


All help needed 


120 


72 


192 






2 


Wish there had been more 


11 


116 


127 






3 


Didn't seek any help 


109 


198 


307 






Y 


No answer 


11 


28 


39 


21 . 


Who paid the clerical costs of preparing the 


proposal ' 






VI 


19/ 


1 


Department or institution 


188 


300 


488 






2 


Another research project 


8 


8 


16 






3 


Pers onally 


43 


89 


132 






5 


Both institution and personally 


11 


14 


25 






Y 


No answer 


1 


3 


4 



22. 


It is difficult to calculate a nrecise figure, but 


what would 


you 




guess the 


clerical costs of your proposal 


amounted 


to ? 




VI 


20/ 1 


Less than $25 


48 


88 


136 




2 


$25-$49 


72 


121 


193 




3 


$50-$99 


67 


102 


169 




4 


$100 or more 


46 


75 


121 




0 


Cannot guess the cost 


17 


24 


41 




Y 


No answer 


1 


4 


5 



23. 



VI 



24, 

VI 



Altogether, about how many hours did you actually spend preparing 
the proposal? 



21-23/ 


001-020 hours 


35 


71 


106 




021-040 


60 


109 


169 




041-060 


44 


64 


108 




061-080 


21 


34 


55 




081-100 


31 


51 


82 




101-500 


42 


66 


108 




YYY No answer 


18 


19 


37 


Did you prepare the proposal on your own 


time or 


on working 


time? 


24/ 1 


Own time 


126 


221 


347 


2 


Working time 


50 


77 


127 


3 


Both oivn and working time 


72 


112 


184 


Y 


No answer 


3 


4 


7 



23o 



Not 

Funded Funded Total 

25. Field readers evaluate each proposal 

according to four criteria: (1) educa- 

tional significance; (2) soundness of 
research design; (3) adequacy of person- 
nel and facilities; and (4) economic 
efficiency . 

(a) Do you think it is appropriate for 
each proposal to be judged by all 
of these criteria? 



25/ 


1 


Yes 


229 


348 


577 




2 


No 


20 


57 


77 




Y 


No answer 


2 


9 


11 


IF NO: 


Should eliminate: 








8/ 


1 


Educational significance 4 


15 


19 


9/ 


1 


Soundness of research 


design 2 


15 


17 


10/ 


1 


Adequacy of personnel 


and facilities 5 


15 


20 


11/ 


1 


Economic efficiency 


11 


27 


38 


13/ 


1 


No answer 


2 


11 


13 


12/ 


1 


DNA; Present criteria 


i appropriate 229 


348 


577 








(253) 


(431) 


(684) 


(b) 


Should other criteria be 


added ? 






27/ 


1 


Yes 


24 


53 


77 




2 


No 


165 


215 


380 




Y 


No answer 


62 


146 


208 



IF YES : Criteria specified: 



VI 



29/ 1 Significance beyond education 11 

2 Creativity 8 

3 Replicability 2 

4 Dissemination 2 

9 Other (e.g., theoretical importance; 

student financial need) 1 

Y No answer 62 

X DNA: No other criteria needed 165 



20 31 

20 28 

2 
2 

10 11 

149 211 

215 380 



O r') 

o C: 



o 



26. 


Do you think that a copy of the comments 
made by field readers should be sent 
routinely to each applicant? 


Funded 


Not 

Funded 


Total 


VI 


30/ 1 


Yes, to every applicant 


210 


362 


572 




2 


Yes, but only to not funded 


14 


32 


46 




3 


Yes, but only to funded 


5 




5 




4 


No, not to any applicant 


9 


6 


15 




5 


Yes, only if requested 




2 


2 




0 


No opinion 


10 


11 


21 




Y 


No answer 


3 


1 


4 



27. It is not unnatural for field readers to be influenced by their own 
professional interests and experieiices . For each of the groups 
listed below, please indicate the kind of reviewer who would be 
most likely to recognize the distinctive aspects of your proposal. 



31/ 1 


Education 


104 


191 


295 


2 


Psychology 


50 


59 


109 


3 


Sociology 


15 


24 


39 


9 


Any other 


27 


57 


84 


0 


Mo preference 


53 


78 


131 


V 

X 


No answer 


2 


5 


7 



Comparison 


of choice with major field: 








78/ 4 


Same as respondent 


147 


253 


400 


5 


Different from respondent 


49 


78 


127 


6 


Cannot determine, no preference 










indicated 


53 


78 


131 


- Y 


No answer 


2 


5 


7 



Research interest of reviewers: 








32/ 1 


Basic research 


59 


82 


141 


2 


Applied research 


135 


219 


354 


9 


Other (e.g., none necessary) 


2 


8 


10 


0 


No preference 


51 


81 


132 


Y 


No answer 


4 


24 


28 



O 











Not 










Funded 


Funded 


Total 


27. 


(Continued) 










Locale 


of reviewer: 








VI 


33/ 1 


Major university 


98 


132 


230 




2 


Small college 


19 


45 


64 




3 


Other educational institution 












(e.g.. State Dept, of Education) 


28 


61 


89 




4 


Commercial organization 


4 


2 


6 




9 


Other (e.g., School of Nursing) 


5 


15 


20 




0 


No preference 


90 


150 


240 




Y 


No answer 


7 


9 


16 



28. 


Did 


you 


have to wait less time 


or a longer time 


than you expected 




to 


learn that the proposal was 


funded ? 






VI 


34/ 


1 


Less than expected 


15 


15 


30 






2 


About Vifhat expected 


60 


129 


189 






3 


Somewhat longer 


64 


115 


179 






4 


Considerably longer 


109 


151 


260 






Y 


No answer 


3 


4 


7 



31. [30] 


* 


Was there anything 


especially noteworthy, either positive 






or negative, about 


the way the USOE Regional 


Office 








processed the proposal? 






VI 38/ 


1 


Yes 


118 


208 


326 




2 


No 


130 


179 


309 




Y 


No answer 


3 


27 


30 



IF YES: Positive comments: 








VI 59/ 2,4 Processing 


11 


1 


12 


5 General administrative handling 


31 


14 


45 


6 Feedback on evaluation 


1 


6 


7 


7 Processing and handling 


6 


3 


9 


8 Handling and feedback 


- 


4 


4 


0 Processing, handling, and feedback 


- 


1 


1 



(49) (29) (78) 



* Bracketed number refers to item number in Not Funded Question- 
naire . 



O 

ERIC 



A 






Not 

Funded Funded Total 

31 . [30] (Continued) 

IF YES: Negative comments: (first or 

only comment) 



77/ 1,2 Processing 


9 


10 


19 


3 RRP funds 


37 


13 


50 


4,5 General administrative 
handling 


33 


61 


94 


6 No feedback 


-- 


52 


52 


7 Need to be kno\xn 


-- 


5 


5 


8 USOE implementation of RRP 


-- 


8 


8 


9 Other (e.g., "We disagree") 


-- 


36 


36 


0 Both processing and handling 


1 


2 


3 


(80) 


(187) 


(267) 



IF YES: 


Negative comments : (second 










comment) 








76/ 


1,2 Processing 


3 


12 


15 




3 RRP funds 


7 


10 


17 




4,5 General administrative 










handling 


— 


18 


18 




6 No feedback 




2 


2 




0 Both RRP funds and feedback 




f 

X 


1 






(10) 


(42) 


(52) 


39, 77/ 


Y No reason stated 


4 


30 


34 


39/ 


X DNA: Nothing positive note- 










worthy 


198 


355 


553 


77/ 


X DNA: Nothing negative note- 










worthy 


167 


197 


364 



n n C\ 
•C o J 



O 



FUNDED APPLICANTS ONLY 



Funded 

29. Before contracting for this research, did 
the USOE Regional Office require changes 
in the proposed research? 



39/ 


1 


Research design 


29 


40/ 


1 


Data collection instruments 


8 


41/ 


1 


Sample 


5 


42/ 


1 


Modes of analysis 


23 


43/ 


1 


Budget 


60 


45/ 


1 


Editing 


19 


46/ 


1 


Timing of phases 


10 


38/ 


1 


Bibliography 


3 


44/ 


1 


No changes required 


120 


47/ 


1 


Other (e.g., title, consultant) 


3 


49/ 


1 


No answer 


5 

(285) 



IF CHANGES REQUIRED : Hou' did you feel about making these 

changes ? 



VI 73/ 1 Strengthened the research 52 

2 Of small consequence 63 

3 Detracted from the research 12 

Y No answer 5 

X DNA: No changes required 119 



30. Did you begin the research on the proposed starting date? 



VI 74/ 1 Yes 

2 No 

Y No answer 



102 

14S 

1 



IF NO : What problems did the change in starting date 

create, if any? 



Ill 



52/ 1 Data collection 

53/ 1 Own work schedule 

54/ 1 Recruiting staff 

55/ 1 Paying project costs 

56/ 1 Contracting for equipment 

51/ 1 No problems 

58/ 1 No an.swer 

57/ 1 DNA: Began on proposed date 



47 

79 

36 

34 

6 

16 

26 

102 

(346) 





FUNDED APPLICANTS ONLY 



Funded 

32. Were you required to obtain clearance from 
USOE for any data-collection instruments 
used in this research? 



VII 7/ 1 Yes 

2 No 

Y No answer 



51 

199 

1 



IF YES : (a) How long did it take to get clearance? 



VII 8-9/ 01-03 Three weeks or less 24 

04-99 More than three weeks 21 

YY No answer 7 

XX DNA: Not required to obtain 

clearance 199 



(b) Did the time required for clearance create any 
problems ? 



VII 10/ 1 Major obstacles 3 

2 Minor obstacles 11 

3 No particular obstacles 33 

Y No answer 4 



X DNA: Not required to obtain clearance 200 



Cc) 


Did the USOE clearance require changes in 
instruments ? 


any 


11/ 


1 


Deletion of items 


4 




3 


Editing of items 


3 




4 


Entire instrument (s) discarded 


2 




0 


No changes 


38 




Y 


No answer 


4 




X 


DNA; Not required to obtain clearance 


200 



(d) Was USOE clearance helpful, or was it a hindrance? 



VII 



12 / 



1 Yes, helpful 3 

2 No, a hindrance 8 

3 No effect 36 

Y No answer 4 



X DNA: Not required to obtain clearance 200 





FUNDED APPLICANTS ONLY 



O 

ERIC 





Funded 

33. Few researchers can anticipate all the contingencies 
that arise in a research project. While carrying out 
this research, did you have to depart from your plans? 



VII 



13/ 1 Sample 

2 Time schedule (e.g., for data collection, 

analysis, preparing final report) 

3 Instruments or modes of analysis » 

4 Sanqjle and time schedule 

5 Sample and instruments or modes of analysis 

6 Time schedule and instruments or modes of 

analysis 

7 Sample, time schedule and instruments or 

modes of analysis 
74/ 8 Design 

74/ 9 Other (e.g,, staffing) 

13/ 0 Did not have to depart from original plans 

Y No answer 
X DNA: Not yet started 



18 

59 

25 

18 

5 

11 

12 

14 

2 

88 

4 

1 _ 

(257) 



34. Did you encounter problems in obtaining the cooperation of 
schools or access to subjects? 



VII 14/ 1 Major problems 14 

2 Minor problems 67 

3 No problems 129 

4 Not applicable: No schools or subjects in study 40 

Y No answer 1 



35. Did you have major difficulty obtaining project help of the 
follov'/ing kinds? 



Ill 61/ 1 Clerical help 29 

62/ 1 Research assistants 16 

63/ 1 Cooperation of administrators at own institution 18 

64/ 1 Assistance of consultants (or advisors) when 

needed 15 

60/ 1 No major difficulty 193 

65/ 1 No answer 3 



(274) 



36. Did you find that so much time was spent collecting data that 
less time for analysis was available than originally planned? 



VII 16/ 1 


Yes 


58 


2 


No 


169 


0 


No data collected 


18 


Y 


No answer 


6 






FUNDED APPLICANTS ONLY 



Funded 



37. 


Did you discover that the project had been under- 
budgeted in any of the following respects? 




Ill 


68/ 


1 


Personnel 


68 




69/ 


1 


Travel 


57 




70/ 


1 


Supplies and materials 


38 




71/ 


1 


Communications 


13 




72/ 


1 


Services 


41 




73/ 


1 


Equipment 


13 




74/ 


1 


Final report 


10 




67/ 


1 


Project was not underbudgeted 


103 




75/ 


1 


No answer 


8 



(351) 



38. 


Have you prepared any progress reports for the USOE 
Regional Office? 




VII 


18/ 1 Yes 


197 




2 No 


27 




0 None required 


r- 




Y No answer 


2 



IF YES : Was the preparation of the progress report much 

of a problem? 



VII 19/ 1 No, request easily met 132 

2 No, but time could have been better spent 46 

3 Yes, a chore 13 

9 Other (e.g., helped check progress) 4 

Y No answer 5 

X DNA: No progress report prepared 51 



39. Have you submitted a final report on the project to the 
USOE Regional Office? 



20/ 1 


Yes 


120 


2 


No 


130 


Y 


No answer 


1 


IF YES: 


(a) Was the final report completed within the 
grant period? 


1 

» 

i 


21/ 1 


Yes 


72 I 


2 


No 


48 : 


Y 


No answer 


1 


X 


DNA: Final report not submitted 


130 



FUNDED APPLICANTS ONLY 



Funded 



39. 


CContinued) 






(b) 


Are you currently engaged in research? 




VII 


22/ 


1 


Research on education 


48 




or 


2 


Research in another field 


18 


VII 


76/ 


4 


Education and another field 


16 






3 


Not engaged in research 


33 






Y 


No answer 


4 






X 


DNA; Final report not submitted 


133 



40. 


If you have not completed this research project. 






how 


far 


have you progressed? 




VII 


23/ 


1 


Just received grant 


5 






2 


One -fourth completed 


2 






3 


One-half completed 


21 






4 


Three -fourths completed 


32 






5 


Nearly completed 


69 






Y 


Mo answer 


2 






X 


DNA: Final report completed 


120 


41 . 


Have you submitted another proposal to the Regional 






Research Program? 




VII 


24/ 


1 


Yes 


37 


or 


2 


No 


2J4 


VII 


77/ 










IP 


/£S: 


Itfhf.t is the status of this proposal? 




VII 


25/ 


1 


Funded 


9 


o: 




2 


Pending 


21 


VII 


78/ 


3 


Not funded 


7 






X 


DNA: Did not submit another proposal 


214 



NOT FUNDED APPLICANTS ONLY 



Not 

Funded 



[29]* 


Did 


you 


ask for an explanation of the decision? 




VI 


35/ 


1 


Yes 


288 






2 


No 


121 






Y 


No answer 


5 




IF YES: 


(a) Qualities of prop'll al criticized: 




III 


15/ 


1 


Educational significance 


87 




16/ 


1 


Soundness of design 


106 




17/ 


1 


Adequacy of personnel and facilities 


14 




18/ 


1 


Economic efficiency 


18 




19/ 


1 


Other (e.g., review of literature) 


12 




Other explanation: 






20/ 


1 


No RRP funds 


34 




21/ 


1 


No explanation provided 


46 




22/ 


1 


Conflicting priority (e.g., within F.RIC/CRIER) 


14 




23/ 


1 


Vague, broad generalities 


12 




25/ 


1 


No answer 


2i 




24/ 


1 


DNA: Didn't ask for explanation of decision 


121 

(485) 




(b) 


How satisfied were you with the explanation? 




VI 


37/ 


1 


Very satisfied 


6 






2 


Fairly 


45 






3 


Not 


213 






Y 


No answer 


29 






X 


DNA: Didn't ask 


121 



[31] Did the Regional Director of Educational Research suggest 

other funding agencies to which you might apply for support? 



VI 41/ 1 Yes 26 

2 No 372 

3 Does not recall 4 

1 No answer 12 



[32] 


Have 


you made other attempts to have this proposal 


funded ? 


VI 


42/ 


1 


Yes 


118 






2 


No 


290 






3 


No answer 


6 



ERIC 



*Henceforth bracketed number refers to item number in Not Funded 
Questionnaire . 



NOT FUNDED APPLICANTS ONLY 



Not 

Funded 



[32] (Continued) 



IF YES : (a) Where did you seek support? 



Ill 


27/ 


1 


Institution of affiliation 


54 




29/ 


1 


USOE 


6 




30/ 


1 


Other federal agency 


15 




31/ 


1 


State government 


10 




32/ 


1 


Private foundation 


21 




33' 


1 


Other, not specified 


9 




34/ 


1 


Other (e.g., business, AFT) 


7 




36/ 


1 


No answer 


7 




35/ 


1 


DNA: Did not seek support 


290 










(419) 








(b) -IVhen did you c( itact them? 




VI 


44/ 


1 


Wl'Me proposal considered by USOE 


33 






2 


After USOE rejection 


78 






Y 


No answer 


13 






X 


DNA: Did not seek support 


290 







(c) What is the status of the proposal? 




VI 


45/ 1 


Funded 


73 




2 


Pending 


13 




3 


Not funded 


28 




Y 


No answer 


10 




X 


DNA: Did not seek support 


290 



[33] 


Have you 
Research 


submitted another proposal to the Regional 
Program? 




VI 


46/ 1 


Yes 


35 


or 


2 


No 


376 


VII 


77/ Y 


No answer 


3 





IF YES: 


What is the status of the proposal? 




VI 


47/ 


1 


Funding 


7 


or 




2 


Pending 


10 


VII 


78/ 


3 


Not funded 


18 






Y 


No answer 


3 






X 


DNA; No other proposal submitted to RRP 


376 



O 

ERIC 






NOT FUNDED APPLICANTS ONLY 



Not 

Funded 



[34] Are you currently engaged in research? 



VI 


48/ 1 


Yes 


267 




2 


No 


146 




Y 


No answer 


1 



IF ' 


YES: 


Field: 




VI 49/ 


1 


Education 


184 


or 


2 


Another field (name of field in I 7-8/) 


56 


VII 76/ 


4 


Both education and another field 


25 




Y 


No answer 


3 




X 


DNA: Not currently engaged in research 


146 





IF NO: 


Any plans to begin a project? 




VI 


50/ 1 


Yes 


63 




2 


No 


59 




Y 


No answer 


25 




X 


DNA: Engaged in research 


267 





IF YES: 


Field : 




VI 


51/ 1 


Education 


54 




2 


Another field (name of field in I 7-8/) 


6 




3 


Both education and another field 


3 




Y 


No answer 


25 




X 


DNA: No research plans 


326 



[35] 


Not 


funded applicant was asked to state the title of 






his 


current research project. This title was compared 






with 


the 


i one on the proposal . 




VI 


60/ 


1 


Same as proposal 


36 






2 


Not same; different focus 


156 






3 


Not same; parallel focus 


58 






Y 


Title not stated 


18 






X 


DNA: Not engaged in research 


146 



O 

ERIC 



c •) 



NOT FUNDED APPLICANTS ONLY 



Not 

Funded 



[36] 


Duration of project : 




VI 


52-53/ 


Month beginning 




VI 


54-55/ 


Year beginning 








1966 or before 


16 






1967 


16 






1968 


64 






1969 or later 


94 






YY No answer 


78 






XX DNA; Not engaged in research 


146 



VI 


56-57/ 


Mon^-h ending 




VI 


58-59/ 


Year ending 








1969 or before 


59 






1970 or later 


89 






YY No answer 


120 






XX DNA: Not engaged in research 


146 



[37] 


Source 


of 


funds : 






(First 


agency nanied 65/; second named 64/; if self 


named 63/) 


VI 


64,65/ 


1 


USOE 


34 






2 


Other federal agency 


31 






3 


State agency 


18 






4 


Private foundation 


8 






5 


Commercial organization 


3 






6 


Educational organization 


3 






7 


Current institution 


89 






8 


"Private donations" 


5 






9 


Other (e.g., municipal government) 


6 






0 


Local school 


16 




63/ 


1 


Self 


54 




65/ 


Y 


No answer 


33 






X 


DNA: Not engaged in research 


146 

(446) 



[38] 


Amount 


of support: 




VI 


66-71/ 


$10,000 or less 


103 






$10,001-$50,000 


34 






More than $50,000 


21 






YYYYYY Not specified 


110 






XXXXXX DNA: Not engagc;d in research 


146 




24 : 













Not 












Funded 


Funded 


Total 


42 . 


[39] 


Have any students assisted you 












on 


this project? 








VII 


26/ 


1 


Yes 


164 


169 


333 






2 


No 


86 


92 


178 






y 


No answer 


1 


7 


8 






X 


DNA: Not engaged in research 


- 


146 


146 



IF YES: As a result of their experience on this project, have any 

of them decided they will do further work in research? 



VII 27/ 1 


Yes 


82 


104 


186 


2 


No 


12 


5 


17 


3 


Don ’ t know 


69 


57 


126 


Y 


No answer 


2 


10 


12 


X 


DNA; No students assisted 
on project 


86 


238 


324 



43. 


[40] 


Has 


. this project been discussed in 


any class? 






VII 


28/ 


] 


Yes, but no data presented 


91 


75 


166 






2 


Yes, and data presented 


95 


98 


193 






4 


Discussed both with and without 














presenting data 


1 


8 


9 






3 


Not discussed 


34 


43 


77 






0 


Not applicable 


29 


32 


61 






Y 


No answer 


1 


12 


13 






X 


DNA: Not engaged in research 


- 


146 


146 



44. 


[41] 


Has 


. this research led to the addition 


of new 


materials 


to 






course reading lists? 








VII 


29/ 


1 


Yes 


83 


131 


214 






2 


No 


161 


117 


278 






Y 


No answer 


7 


20 


27 






X 


DNA: Not engaged in research 


- 


146 


146 




2 ^ 



Not 

Funded Funded Total 

45. [42] Are data from this project being used 
by students for independent study 
projects? For master’s essays? For 
doctoral dissertations? 



VII 30/ 



46. [43] 
VII 31/ 



1 


Independent study projects 


38 


3 7 


/5 


2 


Master's essays 


5 


19 


24 


3 


Doctoral dissertations 


37 


27 


64 


4 


Independent study projects and 
master's essays 


12 


15 


27 


5 


Independent study projects and 
doctoral dissertations 


5 


14 


19 


6 


Master's essays and doctoral 
dissertations 


4 


7 


11 


7 


Independent study projects, master's 
essays, and doctoral dissertations 


6 


13 


19 


0 


Not applicable 


138 


117 


255 


Y 


No answer 


6 


19 


25 


X 


DNA: Not engaged in research 


- 


146 


146 



Have you encouraged any students to pursue this line of research 
for independent study projects? For master’s essays? For 
doctoral dissertations? 



1 


Independent study projects 


37 


29 


66 


2 


Master's essays 


ii 


21 


32 


3 


Doctoral dissertations 


32 


33 


65 


4 


Independent study projects and 
master's essays 


19 


15 


34 


5 


Independent study projects and 
doctoral dissertations 


11 


1C 


29 


6 


Master's essays and doctoral 
dissertations 


9 


12 


21 


7 


Independent study projects, master's 
essays, and doctoral dissertations 


14 


23 


37 


0 


Not applicable 


113 


99 


212 


Y 


No answer 


5 


18 


23 


X 


DNA: Not engaged in research 


- 


146 


146 





) 











Not 










Funded 


Funded 


Total 


47, 


[44] 


Since you have undertaken this 
project, do you find that students 
are more likely to seek your advice 
regarding M.A. or doctoral theses? 








VII 


32/ 


I Students are more likely to seek 












my advice 


68 


88 


156 






2 No noticeable change 


69 


58 


127 






0 Not applicable 


III 


105 


216 






Y No answer 


3 


17 


20 






X DNA: Not engaged in research 


- 


146 


146 



48. 


[45] 


As 


a result of this research, have you 


recommended that 


any 






course or curriculum content be modified? 






IV 


8/ 


1 


I have planned a new course 


35 


44 


79 




9/ 


X 


I have revised one or more courses 


43 


66 


109 




10/ 


1 


I have recommended greater emphasis 














on certain topics or the addition 














of new materials 


66 


87 


153 




11/ 


1 


I have suggested courses in allied 














disciplines to students 


15 


42 


57 




12/ 


1 


Other (e,g., new major, summer 














work conference) 


19 


11 


30 




13/ 


1 

j. 


I have not recommended any changes 


107 


99 


206 




15/ 


1 


No answer 


12 


26 


38 




14/ 


1 


DNA; Not engaged in research 


- 


146 


146 










(297) 


(521) 


(818: 



49. [46] 


Have you been invited to discuss this 


research 


with a 


faculty 




or 


student group? 








IV 17/ 


1 


Faculty seminar in my department 


62 


72 


134 


18/ 


1 


Interdepartmental faculty seminar 


32 


44 


76 


19/ 


1 


Faculty-student seminar in my 












department 


57 


56 


113 


20/ 


1 


Interdepartmental faculty-student 












seminar 


23 


33 


56 


21/ 


1 


Student society 


16 


20 


36 


22/ 


1 


Have not been invited 


110 


100 


210 


24/ 


1 


No answer 


6 


28 


34 


23/ 


1 


DNA: Not engaged in research 


- 


146 


146 








(306) 


(499) 


(805) 















Not 










Funded 


Funded 


Total 


50. 


[47] 


Have you presented (or will you 
present) a paper based on this 
project at a state, regional or 
national meeting of a professional 
society? 








VII 


35/ 


1,3 Yes 


159 


167 


326 






2 No 


92 


79 


171 






Y No answer 


- 


22 


22 






X DNA: Not engaged in research 


- 


146 


146 





IF YES; 


At what meetingfs)? 








VII 


36/ 


1 


State meeting 


14 


19 


33 






2 


Regional meeting 


20 


22 


42 






3 


National meeting 


69 


59 


128 






4 


State and regional meeting 


10 


9 


19 






5 


State and national meeting 


8 


7 


15 






6 


Regional and national meeting 


6 


7 


13 






7 


State, regional, and national 














meeting 


11 


16 


27 


I 


9/ 


8 


International meeting 


5 


11 


16 


VII 


41/ 


9 


Invited lecture 


17 


18 


35 




36/ 


Y 


No answer 


4 


26 


30 






X 


DNA: Not engaged in research or 














no paper presented 


92 


231 


323 










(256) 


(425) 


C68i; 



IF YOU HAVE NO PLANS TO PUBLISH : Please state your reason for 

not doing so. 

I 16/ 1 Time too limited (e.g., can't 

find time to analyze data; 

other interests take priority) 7 4 11 



2 Premature (e.g., depends on 

research results) 11 



9 20 



3 Research too limited (e.g., scope 

of effort only of local interest; 
project only part of a larger 
one; follow-up research needed; 

not significant) 7 4 11 



4 Another investigator to do so 

(e.g., PI; doctoral candidate; 

project evaluator; consultant) 426 







S..,' 



50. [47] 


(Continued) 




Not 










Funded 


Funded 


Total 


I 16/ 


5 


Other (e.g., manuscript inap- 












propriate--films from research 
are "publications"; TV program 
materials; project to develop 
a particular curriculum; final 
report suffices) 


4 


1 


5 




6 


No reason given 


11 


6 


17 




Y 


No answer 


35 


56 


91 




X 


DNA: Pis ns to publish or not 












engaged in research 


172 


332 


504 



51. 


[48] 


Are 


you writing (or have you written) 


any manuscripts 


for 






publication based on this research? 








VII 


37/ 


1 


Yes 


174 


186 


360 






2 


No 


77 


69 


146 






Y 


No answer 


- 


13 


13 






X 


DNA: Not engaged in research 


- 


146 


146 




IF YES: 


IVhat does this include? 








VII 


38/ 


1 


Journal article 


123 


no 


233 






2 


Book or part of a book 


10 


15 


25 






9 


Other (e.g., limited circulation 














report, musical score, test 
manual) 


14 


15 


29 






4 


Journal article and book or 














part of book 


19 


32 


51 






5 


Journal article and other 


2 


7 


9 






6 


Book or part of book and other 


1 


1 


2 






7 


Journal article, book or part of 














book, and other 


2 


- 


2 






Y 


No answer- 


3 


19 


22 






X 


DNA: Not engaged in research or 














no plans to publish 


77 


215 


292 




9 



' > 



Total 



Not 

Funded Funded 

51. [48] (Continued) 

IF JOURNAL ARTICLE : Subject classification 

of journal 



10 


Physical education, health, 
recreation 




3 


3 


11 


Educational administration 


- 


1 


1 


13 


T ‘Search and statistics 


3 


3 


6 


14 


Teacher training 


- 


1 


1 


15 


AV and instructional technoictgy 


2 


1 


3 


16 


Special education (e.g., adult, 
higher) 


6 


3 


9 


17 


Classroom teaching 


7 


9 


16 


18 


Vocational and applied arts 
(e.g., agriculture) 


4 


4 


8 


20 


General psychology 


1 


1 


2 


21 


Developmental 


3 


- 


3 


22 


Guidance and counseling 


2 


3 


5 


24 


Personality 


1 


- 


1 


25 


Testing and measurement 


2 


- 


2 


26 


Educational psychology 


3 


1 


4 


27 


Clinical psychology 


1 


- 


1 


28 


Exceptional children 


1 


2 


3 


31 


Sociology 


1 


- 


1 


32 


Political science 


2 


- 


2 


33 


History 


- 


2 


2 


34 


Other social science 


1 


4 


5 


35 


Math; physical; biological 
sciences 


3 


8 


11 


36 


English and language arts 


8 


5 


13 


37 


Music and art 


2 


6 


8 


38 


Other profession (e.g., law, 
medicine) 




4 


4 


39 


Professional or honorary 

society journal (e.g., AAUP 
Bulletin, Phi Delta Kappan) 


3 


1 


4 


YY 


Journal not specified 


91 


102 


193 


XX 


DNA: Not publishing or not 

engaged in research 


104 


250 


354 



See Appendix B for detailed listing jf professional 
societies which sponsor journals 





12-14/ 



[49] 


Have you received requests for 
copies of any written materials 
based on this project? 


Funded 


Not 

Funded 


Total 


26/ 


1 


Proposal 


83 


57 


140 


27/ 


1 


Instruments used in research 


42 


54 


96 


28/ 


1 


Preliminary report 


47 


66 


U3 


29/ 


1 


Project memoranda, etc. 


11 


24 


35 


30/ 


1 


Final report 


133 


78 


211 


31/ 


1 


Other (e.g., data, visit to lab) 


22 


11 


33 


32/ 


1 


No request received 


63 


87 


150 


34/ 


1 


No answer 


- 


28 


28 


33/ 


1 


DNA: Not engaged in research 


(401) 


146 

(551) 


146 

(952) 



[50] 


As 


a result of this research, have you 


received 


any of 


the 




following requests or invitations? 








44/ 


1 


Asked by colleague to critically 












read a paper 


83 


87 


170 




2 


Not asked 


149 


119 


268 




Y 


No answer 


19 


62 


81 




X 


DNA; Not engaged in research 


- 


146 


146 


45/ 


1 


Asked by a journal to evaluate an 












article on a related topic 


24 


31 


55 




2 


Not asked 


206 


161 


367 




Y 


No answer 


21 


76 


97 




X 


DNA; Not engaged in research 


- 


146 


146 








(502) 


(828) 


(1330) 


46/ 


1 


Asked by a journal to review a 












book on a related topic 


15 


23 


38 




2 


Not asked 


217 


169 


386 




Y 


No answer 


19 


76 


95 




X 


DNA; Not engaged in research 


- 


146 


146 


47/ 


1 


Approached by a publisher about 












writing a book on this subject 


33 


45 


78 




2 


Not approached 


198 


153 


351 




Y 


No answer 


20 


70 


90 




X 


DNA: Not engaged in research 


- 


146 


146 


48/ 


1 


Asked by a funding agency to 












evaluate a proposal in this or 
a /elated area of research 


13 


21 


34 




2 


Not asked 


217 


170 


387 




Y 


No answer 


21 


77 


98 




X 


DNA; Not engaged in research 


- 


146 


146 




r- 






Not 



53. 


[50] 


(Continued) 


Funded 


Funded 


Total 


VII 


49/ 


1 


Invited by a funding agency to 














submit a proposal for further 
research in the area 


16 


20 


36 






2 


Not invited 


214 


167 


381 






X 


No answer 


21 


81 


102 






X 


DNA; Not engaged in research 


- 


146 


146 



54. [51] 


Since you have had this research experience. 


have you been 


asked to serve as a consultant T.-tr any 


of the 


fol lowing 


groups ? 


IV 36/ 


1 


Board of Education 


30 


53 


83 


37/ 


1 


State Department of Education 


33 


44 


77 


38/ 


1 


Federal Government 


13 


25 


38 


39/ 


1 


Commercial producer of learning 












materials 


17 


27 


44 


40/ 


1 


Single educational institution 


23 


34 


57 


41/ 


1 


No requests received 


157 


120 


277 


45/ 


1 


No answer 


19 


38 


57 


42/ 


1 


DNA: Not engaged in research 


- 


146 


146 








(292) 


(487) 


(779) 



55. [52] 


Was your teaching load reduced to enable you 


to devote 


more 




time to ^his research? 








Vil 51/ 


1 


Yes 


83 


63 


146 




2 


No 


108 


145 


253 




0 


Do not teach 


58 


47 


105 




Y 


No answer 


2 


13 


15 




X 


DNA; Not engaged in research 


- 


146 


146 


56. [53] 


As 


a result of working on this project. 


have 


you improved your 




sk 


ills in any of the following areas? 








Part 


I. 










IV 45/ 


1 


Supervising research assistar.ee 


115 


100 


215 


46/ 


1 


Expository writing 


112 


100 


212 


47/ 


1 


Research budgeting 


163 


102 


265 


48/ 


1 


Developing a research design 


160 


144 


304 


49/ 


1 


Sampling techniques 


64 


68 


132 


50/ 


1 


Survey techniques (interviewing. 












questionnaire construction) 


61 


67 


128 


51/ 


1 


Locating relevant literature 












through ERIC 


51 


46 


97 


52/ 


i 


Utilizing general library resources 


53 


65 


118 


53/ 


1 


Computer programming 


80 


84 


164 


54/ 


1 


Modes of analysis 


133 


128 


261 








(992) 


(904) 


(iS96) 



O 

ERIC 



56. [53] (Continued) 

Part II. Modes of Analysis: 



Funded 



Not 

Funded 



Total 



58/ 


1 


Analysis of covariance 


36 


41 


77 


59/ 


1 


Analysis of variance 


57 


58 


115 


60/ 


1 


Correlation or regression analysis 


o8 


56 


94 


61/ 


1 


Descriptive analysis (non- 












analytical) 


30 


29 


59 


62/ 


1 


Discriminant function analysis 


9 


11 


20 


63/ 


1 


Factor or cluster analysis 


15 


26 


41 


64/ 


1 


Qualitative or historical analysis 


7 


18 


25 


65/ 


1 


Tests of significance (t tests, 












chi-square, non -parametric, etc.) 


61 


65 


126 


66/ 


1 


Other (e.g., item analysis, trend 












analysis, Q-sort) 


13 


13 


26 


67/ 


1 


No improvement indicated in any 












of above modes of analysis 


- 


3 


3 


56/ 


1 


No answer Part I 


13 


50 


63 


69/ 


1 


No answer Part II 


3 


36 


39 


55/ 


1 


DNA: Not engaged in research 


- 


146 


146 


63/ 


1 


DNA: Not engaged in research or 












modes of analysis (54/) not 
checked 


115 


248 


363 








(397) 


(800) 


(1197) 


[54] 


What effect has this research experience had on 


your 


interest 




in 


doing research on education? 








54/ 


1 


Strengthened interest in doing 












research on education 


176 


130 


306 




2 


No appreciable effect 


65 


88 


153 




3 


Diminished interest 


7 


24 


31 




Y 


No answer 


3 


26 


29 




X 


DNA: Not engaged in research 


- 


146 


146 



Not 

Funded Funded Total 

58. [55] Vfliat is your employment status now? 



VII 55/ 



1 Employed full-time 

2 Employed part-time 

3 Graduate student full-time 

4 Graduate student part-time 

5 Employed full-time and employed 

part-time 

6 Employed full-time and graduate 

student part-time 

7 Employed part-time and graduate 

student full-time 

8 Employed part-time and graduate 

student part-time 

9 Other (e.g., housewife) 

0 Graduate student part-time and 
other 

Y No answer 



199 

9 

8 

2 



20 

2 

2 

7 

2 



344 543 

16 25 

3 11 

2 



3 3 

29 49 

2 4 



8 10 

6 13 



1 1 

2 4 



59. [56] Are you still employed by the organization where you were 

when you submitted the proposal to USOE, or have you moved? 



VII 56/ 1 


Yes, still at same organization 


175 


288 


463 


2 


No, has moved 


57 


111 


168 


Y 


No answer 


5 


9 


14 


X 


DNA: Not employed 


14 


6 


20 



IF MOVED; (a) IVhat is your mail, organizational affiliation now? 



VII 57-62/ For organizational ID, see Nash fi.'e (BASR #81050). 

(b) IVhat is your position? (See Appendix A 
for refined classification in VII 63-64/) 



VII 



63/ 



0 Research Director 

1 Faculty 

- F NF- 

Prof. 5 7 

Assoc. 9 13 

Ass’t. 22 41 

Other 4 5 

2 Student assistant or fellow 

3 Administrative officer 

4 Program Director 

5 Counselor or Consultant 

7 Teacher 

8 School administrator 
Y No answer 

X DNA: Still at same 

organization 



4 

40 



1 

5 
2 
4 

1 

6 

188 



11 

66 



4 

12 

r 

7 

3 

1 

12 

293 



15 

106 



5 

17 
7 

11 

3 

2 

18 
481 





Not 

59, [56] (Continued) runded Funded Total 

(c) At this new organization, about 
how much time do you devote to 
research ? 



VII 



VII 



Vli 



VII 



VII 



65/ 1 


More time than 
location 


at former 


8 


30 


38 


2 


About the same 


amount of time 


21 


30 


51 


3 


Less time 




19 


28 


47 


0 


None 




9 


21 


30 


Y 


No answer 




6 


12 


18 


X 


DNA: Still at 


same organization 


188 


293 


481 



(d) 


Did this move 
promotion ? 


to another organization 


represent a 




66/ 1 


Yes 


42 


79 


121 


2 


No 


12 


11 


23 


3 


Not sure 


4 


19 


23 


Y 


No answer 


5 


11 


16 


X 


DNA: Still at 


same organization 188 


294 


482 



IF YES: 


Do you attribute the promotion 


to your 


research 


efforts ? 


67/ 1 


Yes 


10 


20 


30 


2 


Partly 


24 


31 


55 


3 


No 


8 


26 


34 


4 


Don't know 


- 


2 


2 


Y 


No answer 


5 


11 


16 


X 


DNA: Move not a promotion ' r 










did not move 


204 


324 


52 8 



(e) 


Did 


you receive a salary increase 


when you 


made 


this move 


68/ 1 


Yes 




48 


93 


141 


2 


No 




9 


17 


26 


Y 


No 1 


answer 


6 


10 


16 


X 


DNA 


: Still at same organization 


188 


294 


482 



IF YES: 


Do you attribute the increase 


to your 


research efforts? 


69/ 1 


Yes 


10 


16 


26 


2 


Partly 


25 


36 


61 


3 


No 


11 


38 


49 


4 


Don't know 


2 


3 


5 


Y 


No answer 


6 


10 


16 


X 


DNA: No salary increase when 










moved, or did not move 


197 


311 


508 



.'t/ ^ 



60. [57] Have you been promoted since you 
started this research project? 



Funded 



Not 

Funded 



Total 



VII 


70/ 


1 


Yes 


47 


90 


137 






2 


No 


122 


187 


309 






Y 


No answer 


10 


19 


29 






X 


DNA: Moved to another organization 


72 


’18 


190 




IF YES: 


Do you attribute the promotion to your 


research e 


fforts ? 


VII 


71/ 


1 


Yes 


6 


13 


19 






2 


Partly 


31 


41 


72 






3 


No 


7 


31 


38 






4 


Don’t know 


3 


3 


6 






Y 


No answer 


10 


21 


31 






X 


DNA: Not promoted or moved 


194 


305 


499 


61 . 


[58] 


Have you received a salary increase? 








VII 


72/ 


1 


Yes 


149 


260 


409 






2 


No 


18 


19 


37 






Y 


No answer 


12 


17 


29 






X 


DNA: Moved to another organization 


72 


118 


190 




IF YES: 


Do you attribute the increase to your research efforts? 


VII 


73/ 


1 


Yes 


11 


21 


32 






2 


Partly 


63 


84 


147 






3 


No 


61 


139 


200 






4 


Don't know 


12 


11 


23 






Y 


No answer 


14 


22 


36 






X 


DNA: No salary increase or moved 


90 


137 


227 


39. 


[34] 


Are you currently engaged in research? 








VII 


76/ 


1 


Research on education 


48 


184 


232 






2 


Research in another field 


18 


56 


74 






4 


Research on education and another 














field 


16 


25 


41 






3 


Not engaged in research 


35 


146 


181 






Y 


No answer 


4 


3 


7 






X 


DNA: RRP project not completed 


130 


- 


130 



O 

ERIC 



Not 



IF CURRENTLY ENGAGED IN RESEARCH OR 


Funded 


Funded 


Total 


PLANNING A PROJECT: Name of field 

other than education. 

7-8/ 10 Health and recreation 


2 


1 


3 


18 


Applied arts (e.g., agriculture) 


1 


3 


4 


20 


General psychology 


8 


11 


19 


21 


Developmental 


1 


2 


3 


22 


Guidance and counseling 


- 


3 


3 


23 


Learning 


1 


- 


1 


26 


Educational psychology 


- 


1 


1 


28 


Exceptional children 


- 


1 


1 


31 


Sociology- 


3 


3 


6 


32 


Political science 


1 


2 


3 


33 


History 


2 


4 


6 


34 


Other social science 


5 


19 


24 


35 


Math, physical, biological 
sciences 


1 


19 


20 


36 


English and language arts 


7 


13 


20 


37 


Music and art 


1 


5 


6 


38 


Other professions (e .g . , law, 
medi cine) 


1 


3 


4 


YY 


No answer 


1 


2 


•T 


XX 


DNA: Not engaged in research 

in another field 


216 


322 


538 



41. [33] Have you submitted another proposal to the Regional Research 
Program? 



VII 77/ 1 Yes 

2 No 

Y No answer 



37 

214 



35 

376 

3 



72 

590 

3 



IF YES : What is the status of this proposal? 



VII 78/ 1 Funded 9 

2 Pending 21 

3 Not funded 7 

Y No answer 

X DNA: Did not submit another 

proposal 214 



7 16 

10 31 

18 25 

3 3 

376 590 




62. [59] At present, how do you divide your 
professional time? 

Percent time Curriculum or Program 
Development : 

VIII 7-8/ 01-20 

21-40 
41-60 
61-80 
81-100 

RR, 00 No time this area 
YY No answer 
XX Retired 



Funded 



43 

19 

9 

2 

2 

169 

5 

2 



Not 

Funded 



118 

40 

17 

5 

5 

219 

8 

2 



Total 



161 

59 

26 

7 

7 

388 

13 

4 



Percent time Research; 



VIII 9-10/ 



01-20 


66 


123 


189 


21-40 


56 


67 


123 


41-60 


30 


29 


59 


61-80 


7 


14 


21 


81-100 


6 


13 


19 


00 No time this area 


78 


158 


236 


YY No answer 


6 


8 


14 


XX Retired 


2 


2 


4 



Percent time Services: 



VIII 11-12/ 



01-20 
21-40 
41-60 
61-80 
81-100 

RR, 00 No time this area 
YY No answer 
XX Retired 



48 

5 

6 
4 
4 

176 

6 

2 



88 

15 

11 

6 

4 

280 

8 

2 



136 

20 

17 

10 

8 

456 

14 

4 



Percent time Working toward Degree; 

VIII 13-14/ 01-20 

21-40 
41-60 
61-80 
81-100 

YY No answer 

RR, 00, XX DNA: Not working 

toward d''gree 



14 

4 

4 

1 

8 

3 

217 



25 

9 

4 

2 

3 

2 

369 



39 

13 

8 

3 

11 

5 

586 





■') 











Not 




62. [59] 


(Continued) 


Funded 


Funded 


Total 


IF 


WORKING 


TOWARD DEGREE: 








VIII 


15/ 2 


Ed.D. 


13 


17 


30 




3 


Ph.D. 


20 


23 


43 




Y 


No answer 


1 


5 


6 




X 


DNA: Not working 












toward degree 


217 


369 


586 



Percent time Teaching: 








VIII 16-17/ 01-20 


13 


42 


55 


21-40 


36 


74 


110 


41-60 


69 


81 


150 


61-80 


32 


60 


92 


81-100 


27 


43 


70 


RR, 00 No time this area 


66 


104 


170 


YY No answer 


6 


8 


14 


XX Retired 


2 


2 


4 



Percent time Administration or other 








VIII 18-19/ 01-20 


38 


55 


93 


21-40 


27 


49 


76 


41-60 


18 


34 


52 


61-80 


10 


28 


38 


81-100 


14 


25 


39 


RR, 00 No time this area 


137 


212 


349 


YY No answer 


5 


9 


14 


XX Retired 


2 


2 


4 



63. 


[60] At 


present 


, are you an advisor for doctoral dissertations 


? 


VIII 


20/ 


1 Yes 




69 


102 


171 






2 No 




177 


300 


477 






Y No 


answer 


5 


12 


17 




IF YES 


: About 


how many students are you 


current ly 


advising? 




VIII 


21-22/ 


01-03 


Three or less 


28 


44 


72 






04-09 


Four to nine 


26 


38 


64 






10-40 


Ten or more 


8 


18 


26 






00, YY 


No answer 


12 


14 


26 






XX 


DNA: Not advisor for doc- 














toral dissertations 


177 


300 


477 




Funded 



64. [61] If you have had teaching experience: 

(a) Years taught in elementary or 
secondary school 



VIII 23-24/ 



Not 

Funded 



Total 



01-03 


One to three 


52 


90 


142 


04-06 


Four to six 


34 


66 


100 


07-09 


Seven to nine 


26 


31 


57 


10-13 


Ten to thirteen 


12 


32 


44 


14-19 


Fourteen to nineteen 


13 


32 


45 


20-40 


Twenty or more 


7 


13 


20 


RR,00 


No teaching this level 


103 


147 


250 


YY 


No answer 


4 


3 


7 



(b) Years taught college undergraduates 
VIII 25-26/ 



01-03 


One to three 


54 


86 


140 


04-06 


Four to six 


52 


96 


148 


07-09 


Seven to nine 


23 


46 


69 


10-13 


Ten to thirteen 


24 


39 


63 


14-19 


Fourteen to nineteen 


21 


19 


40 


20-41 


Twenty or more 


16 


36 


52 


RR,00 


No teaching this level 


57 


90 


147 


YY 


No answer 


4 


2 


6 



(c) Years taught graduate students 
VIII 27-28/ 



01-03 


One to three 


73 


104 


177 


04-06 


Four to six 


46 


70 


116 


07-09 


Seven to nine 


19 


34 


53 


10-13 


Ten to thirteen 


17 


18 


35 


14-19 


Fourteen to nineteen 


7 


11 


18 


20-35 


Twenty or more 


10 


17 


27 


RR,00 


No teaching this level 


75 


157 


232 


YY 


No answer 


4 


3 


7 



(d) Years done other types of teaching 



VIII 29-30/ 



01-03 


One to three 


27 


45 


72 


04-06 


Four to six 


3 


29 


32 


07-09 


Seven to nine 


1 


7 


8 


10-13 


Ten to thirteen 


2 


12 


14 


14-19 


Fourteen to nineteen 


4 


4 


8 


20-38 


Twenty or more 


1 


8 


9 


RR,00 


No teaching this area 


209 


305 


514 


YY 


No answer 


4 


4 


8 



65. [62] Are you a member of any national 
professional societies? 

VIII 31/ 1 Yes 

2 No 

Y No answer 



Funded 



240 

9 

2 



Not 

Funded 



383 

22 

9 



Total 



623 

31 

11 



IF YES: Which two are of greatest value to you? 

fi cation, FIRST named society) 



? (Subject classi- 



17-18/ 10 

11 

12 

13 

14 

15 

16 

17 

18 



Physical education, health, 
recreation 

Educational administration 
Curriculum 

Research and statistics 
Teacher training 
AV and instructional tech- 
nology 

Special education (e.g., 
adult, higher) 

Classroom teaching 
Vocational and applied arts 



19-21/ 



20 General psychology 

21 Developmental 

22 Guidance and counseling 
28 Exceptional children 

31 Sociology 

32 Political science 

33 History 

34 Other social science 

35 Math; physical; biological 

sciences 

36 English and language arts 

37 Music and art 

38 Other profession (e.g., law, 

medicine) 

39 Profession as role (e.g., 

AAUP) or honorary society 
(e.g.. Phi Delta Kappa) 

YY No answer 

XX DNA: Not member of profes- 

sional society 

See Appendix B for detailed listing of professional 
societies . 



5 


17 


22 


5 


4 


9 


2 


8 


20 


34 


63 


97 


1 


2 


3 


3 


6 


9 


6 


10 


16 


18 


40 


58 


11 


10 


21 


39 


34 


73 


5 


2 


7 


17 


18 


35 


2 


9 


11 


8 


15 


23 


3 


4 


7 


2 


2 


4 


10 


19 


29 


9 


21 


30 


23 


24 


47 


16 


23 


39 


2 


7 


9 


14 


36 


50 


13 


21 


34 


3 


19 


22 



ERIC 



2ov-' 



Not 



32] (Continued) 


Funded 


Funded 


Total 


(Subject classification, SECOND named 
society) 

22-23/ 10 Physical education, health, 

recreation 


4 


9 


13 


11 


Educational administration 


3 


13 


16 


12 


Curriculum 


4 


6 


10 


13 


Research and statistics 


25 


38 


63 


14 


Teacher training 


- 


2 


2 


15 


AV and instructional tech- 
nology 


3 


7 


10 


16 


Special education (e.g., 
adult, higher) 


4 


10 


14 


17 


Classroom teaching 


17 


34 


51 


18 


Vocational and applied arts 


3 


8 


11 


20 


General psychology 


13 


19 


32 


21 


Developmental 


3 


3 


6 


22 


Guidance and counseling 


12 


21 


33 


25 


Testing and measurement 


3 


3 


6 


26 


Educational psychology 


- 


1 


1 


28 


Exceptional children 


7 


9 


16 


31 


Sociology 


2 


8 


10 


32 


Political science 


2 


3 


5 


33 


History 


2 


5 


7 


34 


Other social science 


10 


15 


25 


35 


Math; physical; biological 
sciences 


9 


11 


20 


36 


English and language arts 


15 


18 


33 


37 


Music and art 


7 


8 


15 


38 


Other profession (e.g., lavv, 
medicine) 


2 


5 


7 


33 


Profession as role (e.g., 
AAUP) or honorary society 
(e.g.. Phi Delta Kappa). 


34 


41 


75 


YY 


No answer 


64 


98 


162 


XX 


DNA: Not member of profes- 

sional society 


3 


19 


22 



I 24-26/ See Appendix B for detailed listing of professional 
societies . 



66. [63] Within the last two years have you attended a meeting of an 
academic or professional society? 



1 

2 

Y 



VIII 36/ 



Yes 

No 

No answer 



237 

13 

1 



372 

36 

6 



609 

49 

7 



Not 



67. [64] 


Have you ever been a field reader 
for the U.S. Office of Education? 


Funded 


Funded 


Total 


VIII 


37/ 1 Yes 


19 


27 


46 




2 No 


231 


383 


614 




Y No answer 


1 


4 


5 



IF YES; 


About 


how '’•.any proposals have you 


reviewed ? 






VIII 38-39/ 


01-05 


One to five 


3 


5 


8 




06-10 


Six to ten 


6 


7 


13 




11-20 


Eleven to twenty 


3 


4 


7 




21-99 


Twenty -one or more 


5 


8 


13 




00, YY 


No answer 


3 


7 


10 




XX 


DNA: Has not been a field 












reader for USOE 


231 


383 


614 



IF NO: 


Do 


you know anyone who is 


(or has 


been) 


a field reader? 


VIII 40/ 


1 


Yes 




83 


108 191 




2 


No 




90 


151 241 




Y 


No answer 




59 


128 187 




X 


DNA; Has been a field 


reader 










for USOE himself 




19 


27 46 



68. [65] Have you ever been a consultant to the U.S. Office of 
Education ? 



VIII 


41/ 1 


Yes 


16 


28 


44 




n 


No 


231 


374 


605 




Y 


No answer 


4 


12 


16 










Not 






Funded 


Funded 


Total 


69. [66] How many 


research studies (articles. 








monographs, or books) have you pub- 








lished, and what was the date of 








your first publication? 








Article(s) : 










VIII 42-43/ 01 


One 


22 


39 


61 


02 


Two 


15 


39 


54 


03 


Three 


17 


18 


35 


04 


Four 


17 


18 


35 


05-10 


Five to ten 


42 


67 


109 


11-25 


Eleven to twenty-five 


31 


44 


75 


26-90 


Twenty-six or more 


16 


28 


44 


YY 


No answer 


8 


14 


22 


RR,00 


Published but not articles 


10 


10 


20 


XX 


No publications 


73 


137 


210 


Monograph (s) : 










VIII 44-45/ 01 


One 


18 


33 


51 


02-05 


Two to five 


24 


30 


54 


06-60 


Six or more 


8 


16 


24 


YY 


No answer 


8 


1 5 


23 


RR,00 


Published but not monographs 


120 


183 


303 


XX 


No publications 


73 


137 


210 



Book (s) : 










VIII 46-47/ 01 


One 


26 


39 


65 


02-05 


Two to five 


21 


32 


53 


06-21 


Six or more 


3 


9 


12 


YY 


No answer 


8 


14 


22 


RR,00 


Published but not book 


120 


183 


303 


XX 


No publications 


73 


137 


210 




Date of first publication: 



VIII 48-49/ 



1970 

1968-1969 
1964-1967 
1956-1963 
1940-1955 
Prior to 1940 
YY No answer 
XX No publications 



1 


1 


2 


22 


24 


46 


62 


96 


158 


46 


76 


122 


31 


50 


81 


6 


11 


17 


10 


19 


29 


73 


137 


210 





70. [67] 

VIII 51/ 

71. [68] 
VIII 52/ 

72. [69] 
VIII 53/ 

73. [70] 
VIII 54/ 



Funded 



Not 

Funded 



Total 



Some researchers . . . seek recog- 
nition from behavioral scientists 
outside education, while others seek 
recognition from researchers within 
education or from school practi- 
tioners. Whose judgment is most 
important to you? 

1 Researchers within education 

2 Researchers outside education 

3 School practitioners 
0 None of these 

Y No answer 



V ^ w W y ’ / 

of funding agencies . Do you think the 
few areas of special interest, or does 
of interests in education? 



1 

2 

0 

Y 



Few areas of special interest 
Broad range of interests 
No impression 
No answer 



uo yuu taiiiK. LUC uouc 
in their support of research? 

1 Orthodox 

2 Venturesome 
0 No opinion 
Y No answer 



As far as departures frc 
is it your opinion that 
or somewhat permissive? 

1 Fairly strict 

2 Fairly permissive 
0 No opinion 

Y No answer 



77 


131 


208 


84 


113 


197 


54 


91 


145 


23 


57 


80 


13 


22 


35 


;rs get an 


impression 


RRP is limited to a 


it cover 


a broad 


range 


22 


156 


178 


141 


72 


213 


85 


181 


266 


3 


5 


8 


orthodox or venturesome 


62 


257 


319 


102 


22 


124 


86 


130 


216 


1 


5 


6 


proposal 


are con 


cerned. 


to be fairly strict 


43 


83 


126 


115 


41 


156 


91 


283 


374 


2 


7 


9 



Not 

Funded Funded "rotal 

74. ryil In comparing the procedures that an 

applicant must follow when submitting 
a proposal to RRP with those required 
elsewhere, would you say the RRP 
involves more, about the same, or 
somewhat less "red tape"? 







31 


94 


125 


VIII 55/ 1 


More "red tape" 


Q2 


148 


240 


2 


About th^^ same amount 


58 


49 


107 


3 


Somewha^ less 


69 


117 


186 


0 


No opinion 


1 


6 


7 


Y 


No answer 









75. [72] 



VIII 56/ 



oma researchers view the regulation f 

ducatlonal data-gatherlng instruments ^ 80 od idea , 
thers regard it as an unwarranted intrusion by USOE. 



1 Good idea 

2 Unwarranted intrusion 
0 No opinion 

Y No answer 



80 


141 


50 


89 


115 


175 


6 


9 



221 

139 

290 

15 



76. [73] 
VIII 57/ 



Have you ever submitted 


any data-gathering 


instruments 


to USOE 


for clearance? 










67 


73 


140 


1 Yes 


182 


331 


513 


2 No 


2 


10 


12 


Y No answer 









77. [74] 



VIII 58/ 



you may know, it is ffnalTepo” ZTlllt 

fixed percentage of a grant until P 

Droved. Do you think this is a good idea. 



1 Agree 

2 Disagree 

0 No opinion 
Y No answer 



163 242 405 

39 61 100 

46 106 152 

358 




u 




Funded 

78. [75] The USOE RRP encourages significant 
small scale educational research 
projects. What do you think the 
ceiling on funds should be for small 
project research? 



VIII 59-61/ 


$ 500 


1 


(entered as 


700 




hundreds of 


2,000 




dollars) 


3,000 






4,000 






5,000 


2 




6,000 






6,500 






7,000 


— 




7,500 


1 




10,000 


70 




11,000 


“* 




12,000 


17 




12,500 


3 




13,500 


3 




14,000 


“* 




15,000 


71 




17,500 


9 




20,000 


38 




22,500 


2 




25,000 


12 




30,000 






50,000 


5 




Unlimited 


1 




No answer 


16 



Not 

Funded Total 



1 

3 

2 

1 

12 

1 

1 

2 

2 

151 

1 

5 

6 

1 

61 

4 

55 

28 

3 

4 
1 

69 



1 

1 

3 

2 

1 

14 

1 

1 

2 

3 

221 

1 

22 

9 

3 

1 

132 

13 

93 

2 

40 



85 



medians $14,500 $10,000 $14,500 



to cn CM 



79. [76] 



VIII 64/ 



If you were to get a research grant 
for' $10,000 or less, do you have any 
preference about the source of the 
grant? 

1 Government agency 

2 Private foundation 

9 Other (e.g., private donations, 
local schools) 

0 No preference 
Y No answer 



Funded 



Not 

Funded 



Total 



VIII 



IF PREFERENCE; IVhich of the following influe 

65/ 1 Absence of "red tape" in preparing 

proposal 

66/ 1 Promptness of notification regarding 

support 

67/ 1 Method of proposal review 

68/ 1 Freedom to modify research plans 

69/ 1 Amount of project monitoring by 

funding agency 

70/ 1 Little likelihood of budgetary 

cutback 

71/ 1 Latitude in preparation of final 

report 

72/ 1 Copyright privileges 

73/ 1 Other Ce.g*. receptive to new ideas, 

sympathetic to local concerns) 

75/ 1 No answer 

74/ 1 DNA: No preference 



40 


42 


82 


34 


85 


119 


6 


12 


18 


169 


269 


438 


2 


6 


8 


;nced your choice 


7 


36 


70 


106 


29 


54 


83 


18 


60 


78 


38 


62 


100 


21 


30 


51 


27 


48 


75 


32 


47 


79 


11 


26 


37 


17 


20 


37 


7 


11 


18 


169 


269 


438 


(405) 


(697) 


(1102) 



C ^ 




Not 

Funded Funded To t a 1 

80. [77] Colleges and universities where 
earned a degree . 

IX 7-12/ Institution for first-named degree. 

A See Nash college file (BASR #B1050) 

for explicit institutional ID. 



(1) Earned degree (first named): 



lA 



13/ 1 BA 

2 MA or MBA 

4 Ed.D. 

5 Ph.D. 

6 BS 

7 MS 

9 Professional degree (e.g., MD, 
DDS) 

Y No answer 

X DNA: No earned degree 



149 

2 

2 

6 

91 



1 



213 

12 

6 

15 

154 

3 



362 

14 

8 

21 

245 

3 



1 

4 

6 



1 

4 

7 



(2) Year of Degree (first named) : 

IX 14-15/ 1919-1929 

1930-1938 
1939-1945 
1946-1950 
1951-1954 
1955-1958 
1959-1962 
1962-1969 
YY No answer 
XX DNA: No earned degree 



5 


15 


20 


11 


27 


38 


19 


34 


53 


46 


78 


124 


44 


62 


106 


55 


82 


137 


49 


67 


116 


19 


35 


54 


2 


8 


10 


1 


6 


7 



(3) Major field (first named) : 



(Mapped variable, see Appendix D for 
detailed classifications.) 



IX 16-17/ Education (e.g., elementary, 

secondary, curriculum, audio- 
visual) 

Educational administration 
Vocational and applied arts 
(e.g., industrial arts, home 
economi cs) 

Psychology 
Social science 

Math, physical and biological 
scien ces 

English, philosophy, and 
language arts 
Music and art 

Profession (e.g., medicine, 
law, business) 

00, YY No answer 

XX DNA: No earned degree 



28 

2 



19 

46 

34 

48 

43 

18 

9 

3 

1 



70 


98 


5 


7 



25 


44 


48 


94 


74 


108 


84 


132 


58 


101 


27 


45 


8 


17 


9 


12 


6 


7 



(4) Degree in education (first named) . 

IX 18/ 1 Yes 
2 No 

Y No answer 

X DNA: No earned degree 



Not 

Funded Funded 



75 151 226 

172 251 423 

3 6 9 



IX 

B 



19-24/ Institution for second-named degree. colleg 

(BASR ??B1050) for explicit institutional I . 



(1) Earned degree (second named) 



IX 



25/ 







5 


5 


10 


1 


BA 


110 


202 


312 


2 


MA or MBA 


44 


54 


98 


3 


M.Ed. 


1 


4 


5 


4 


Ed.D. 


13 


17 


30 


5 


Ph.D. 


4 


6 


10 


6 


BS 


66 


98 


164 


7 


MS 








9 


Professional degree (e.g., MD, 


9 


3 


5 




DDS) 


2 


6 


8 


Y 


No answer 


A 


19 


23 


X 


DNA: No earned degree 


4 







(2) Year of degree (second named) : 







5 


13 


18 


IX 26-27/ 


1924-1934 


13 


25 


38 




1935-1945 


42 


73 


115 




1946-1953 


77 


107 


184 




1954-1959 


71 


106 


111 




1960-1964 


35 


56 


91 




1965-1969 


4 


15 


19 


YY 


No answer 


A 


19 


23 


XX 


DNA: No earned degree 


4 







80. [77] (Continued) 

f3] Major field. (second named) : (Mapped 

variable, see Appendix D foi 
detailed classifications.) 

IX 28-29/ Education (e.g., elementary, 

secondary, curriculum, 
audio-visual) 

Educational administration 
Vocational and applied arts 
(e.g., industrial arts, home 
economi cs) 

Psychology 
Social science 

Math, physical and biological 
sciences 

English, philosophy, and 
language arts 
Music and art 

Profession (e.g., medicine, 
law, business) 

YY No answer 

XX DNA; No earned degree 



(4) Degree in education (second named) 



Funded 



Not 

Funded 



Total 



IX 



30/ 1 Yes 

2 No 

Y No answer 

X DNA: No earned degree 



IX 

C 



31-36/ Institution for third-named degree. 

(BASR i^BlOSO) for explicit institutional ID. 



40 


79 


119 


18 


36 


54 


6 


21 


27 


62 


71 


133 


30 


55 


85 


29 


54 


83 


32 


35 


67 


15 


25 


40 


8 


4 


12 


7 


15 


22 


4 


19 


23 


120 


210 


330 


123 


176 


299 


4 


9 


13 


4 


19 


23 


See 


Nash college 


file 



Funded 



(1) Earned degree (third named): 
37/ 



IX 



1 BA 

2 MA or MBA 

3 M.Ed. 

4 Ed.D. 

5 Ph.D. 

6 BS 

7 MS 

8 Other doctorate (e.g., business, 

theology, music) 

9 Professional degree (e.g., MD, 

DOS) 

0 Educational specialist or 
professional diploma 
Y No answer 

X DNA: No earned degree 



2 

2 

1 

59 

107 

4 



3 

3 

64 



Not 

Funded 



10 

4 

87 

163 

6 

4 

3 

4 
3 

10 

120 



Total 



12 

6 

1 

146 

270 

10 

7 

6 

4 

6 

13 

184 



(2) Year of degree (third named) : 



IX 



IX 



IX 



38-39/ 


1925-1944 


2 


16 


18 


1945-1960 


52 


72 


124 




1961-1966 


67 


97 


164 




1967-1969 


58 


93 


151 




1970 


2 


1 


3 


YY 


No answer 


6 


15 


21 


XX 


DNA: No earned degree 


64 


120 


184 


Major fiel 
40-41/ 


d (third named): (Mapped variable, see Appendix 

for detailed classifications) 

Education (e.g., elementary, secon- 


D 




dary, curriculum, audio-visual) 


29 


66 


95 




Educational administration 
Vocational and applied arts (e.g.. 


23 


35 


58 




industrial arts, home economics) 


6 


10 


16 




Psyclology 


59 


63 


122 




Social science 

Math, physical and biological 


19 


35 


54 




sciences 

English, philosophy, and language 


13 


31 


44 




arts 


12 


17 


29 




Music and art 

Profession (e.g., medicine, law. 


11 


15 


26 




business) 


5 


4 


9 


YY 


No answer 


10 


18 


28 


XX 

Degree in 


DNA: N 3 earned degree 

education (third named) : 


64 


120 


184 


42/ 1 


Yes 


109 


172 


281 


2 


No 


73 


110 


183 


Y 


No answer 


5 


13 


18 


X 


DNA: No earned degree 

'rilh 


64 


119 


183 




81 . 
IX 



82. 

IX 



[78] dissertation 



dissertation 
Y No answer 



[79] Sex 

46/ 1 Male 

2 Female 



83. [80] Number oi 

IX 47-48/ 00 None 

01 One 



02 Two 

03 Throe 

04 Foul' 

05-12 Five or more 
YY No answer 



84. [81] 

IX 49-50/ 



Year o£ birth 

Before 1910 
1910-1919 
1920-1924 
1925-1929 
1930-1934 
1935-1939 
1940-1945 
VY No answer 



growing up? 

I 27-28/ See Appendix C for listing of states. 

[b) Where do you live now? 

I 29-30/ See Appendix C for listing of states. 





Not 




Funded 


Funded 


Total 


dissertation 60 


119 


179 


writing a 

191 


293 


484 




2 


2 


203 


347 


550 


48 


67 


115 


, other than self 






40 


56 


96 


34 


56 


90 


39 


61 


100 


67 


107 


174 


39 


75 


114 


28 


53 


81 


4 


6 


10 


7 


20 


27 


27 


49 


76 


25 


56 


81 


51 


96 


147 


59 


95 


154 


60 


63 


123 


20 


31 


51 


2 


4 


6 


live most of the time 


while you 


were 



85. [82] (Continued) 
(c) 



Funding 



How would you characterize 
where you grew up and where 
you live now? 



Grew up : 



IX 55/ 1 Farm 

2 Small town 

3 Moderate size town or city 

4 Suburb of a large city 

5 Large city 

Y No aiiswer 

Live now; 

IX 56/ 1 Farm 

2 Small town 

3 Moderate size toivn or city 

4 Suburb of a large city 

5 Large city 

Y No answer 



Not 

Funding 



Total 



30 


50 


80 


65 


119 


184 


54 


104 


158 


28 


37 


65 


71 


97 


168 


3 


7 


10 



2 


5 


7 


48 


77 


125 


88 


173 


261 


59 


74 


133 


49 


77 


126 


5 


8 


13 



86. [83] What is the highest level of formal education reached by your 
spouse? Father? Mother? 



IX 



(a) Spouse: 
57/ 



IX 58/ 



0 


No spouse 


21 


29 


50 


1 


8th grade or le.ss 


- 


2 


2 


2 


Some high school 


2 


3 


5 


3 


Completed high school 


13 


41 


54 


4 


Some college 


45 


72 


117 


5 


Graduated from college 


42 


81 


123 


6 


Some graduate school 


32 


52 


84 


7 


First professional degree 


14 


12 


26 


8 


Master's Degree 


58 


79 


137 


9 


Ph.D. or Ed.D. 


15 


25 


40 


Y 


No answer 


9 


18 


27 



(b) Father: 



1 

2 

3 

4 

5 

6 

7 

8 
9 
Y 



8th grade or less 


64 


126 


190 


Some high school 


36 


56 


92 


Completed high school 


51 


73 


124 


Some college 


28 


68 


96 


Q-aduated from college 


25 


29 


54 


Some graduate school 


6 


8 


14 


First professional degree 


13 


18 


31 


Master's degree 


11 


13 


24 


Ph.D. or Ed.D. 


11 


9 


20 


No answer 


6 


14 


20 



86. 


[83] 


(Continued) 




Not 










Funded 


Funded 




(c) 


Mother: 






IX 


59/ 


1 


8th grade or less 


45 


107 






2 


Some high school 


58 


49 






3 


Completed high school 


70 


117 






4 


Some college 


39 


70 






5 


Graduated from college 


35 


36 






6 


Some graduate school 


7 


5 






7 


First professional degree 


5 


9 






8 


Master's degree 


5 


7 






9 


Ph.D. or Ed.D. 


2 


1 






Y 


No answer 


5 


13 


87. 


00 
1 i 


Were your parents ever employed in 


educational 


work ? 




(a) 


Father; 






IX 


60/ 


1 


Yes 


42 


54 






2 


No 


205 


350 






Y 


No answer 


4 


10 




(b) 


Mother: 






IX 


61/ 


1 


Yes 


52 


87 






2 


No 


193 


321 






Y 


No answer 


6 


6 



• 

00 

00 


[85] 


In 


what religion were 


you raised 


? What 


is your present 






religion? 












(a) 


Religion in which raised: 








IX 


62/ 


1 


Catholic 






31 


66 






2 


Jewish 






33 


31 






3 


Protestant 






156 


265 






9 


Other (e.g., Greek 


Orthodox, 


Hindu) 


6 


14 






0 


None 






7 


20 






Y 


No answer 






18 


18 




(b) 


Present religion: 










IX 


63/ 


1 


Catholic 






27 


51 






2 


Jewish 






21 


22 






3 


Protestant 






109 


197 






9 


Other (e.g., Greek 


Orthodox, 


Hindu) 


18 


34 






0 


None 






52 


84 






Y 


No answer 






24 


26 



Total 



152 

87 

187 

109 

71 

12 

14 

12 

3 

18 



96 

555 

14 



139 

514 

12 



97 

64 

421 

20 

27 

36 



78 

43 

306 

52 

136 

50 











Funded 


Funded 


Total 


89. [86] 


Race: 










IX 64/ 


1 


Caucasian 




239 


386 


625 




2 


Negro 




4 


8 


12 




9 


Other (e.g.. 


Indian, Oriental) 


2 


5 


7 




Y 


No answer 




6 


15 


21 


90. [87] 


In 


which of the 


following categories 


was your 


total income for 



1968? IVhat do you expect it to be for 1969? 
(a) 1968; 



1 


Under $5,000 


16 


23 


39 


2 


$5,000-$7,499 


19 


14 


33 


3 


$7,500-$9,999 


22 


44 


66 


4 


$10,000-$14,999 


89 


154 


243 


5 


$15,000-$19,999 


65 


100 


165 


6 


$20,000-$24,999 


27 


47 


74 


7 


$25,000-$29,999 


3 


11 


14 


8 


$30,000 or more 


1 


7 


8 


Y 


No answer 


9 


14 


.23 



(b) 1969; 



1 


Under $5,000 


8 


8 


16 


2 


$5,000-$7,499 


6 


5 


11 


3 


$7,500-$9,999 


11 


28 


39 


4 


$10,000-$14,999 


77 


134 


211 


5 


$15,000-$19,999 


88 


115 


203 


6 


$20,000-$24,999 


40 


71 


111 


7 


$25,000-$29,999 


6 


25 


31 


8 


$30,000 or more 


5 


14 


19 


Y 


No answer 


10 


14 


24 




2«0 



DATA ADDITIONS 



91. [88] Topic of Proposal 

(a) Subject matter 
I 40/ 



Funded 



Not 

Funded Total 



41/ 



1 

2 

3 

4 

5 



Agriculture 

Art (manual — graphics, 
painting, sculpture) 

Building design 
Business 

Education (administration, finance, 
history of, philosophy of; 
teacher training) 

English (rhetorical arts — cinema, 
literature, speech, theatre) 
Foreign languages and 
linguistics 
Home economics 
Industrial arts 
Information processing (data 
retrieval systems, library) 



Mathematics and statistics 
Music 

Physical education, health, 
and recreation (dancing) 

Physiological measurements 
Psychology (educational, personality, 
school, testing and measurement, 
counseling, guidance and placement) 
Reading 

Science (biological, environmental, 
or physical) 

Social science (area studies, economics, 
geography, history, international 
relations, political science) 

Speech pathology and audiology 
Behavioral science research, 
environmental focus 
Subject not elsewhere classified 
(e.g.. Headstart, aviation) 

Not classifiable by subject 
(e.go, student activism) 



(b) Instructional methods; 

I 42/ 1 Computer assisted 

2 Programmed 

3 Audio-visual 

Y No instructional method 
indicated 
X Not applicable 



8 

9 

0 



1 

2 

3 

4 

5 



6 

7 



9 

Y 



281 



3 


3 


6 


5 


5 


10 


1 


- 


1 


2 


5 


7 


65 


101 


166 


14 


23 


37 


2 


10 


12 


2 


3 


5 


3 


3 


6 


8 


12 


20 


16 


21 


37 


11 


17 


28 


7 


17 


24 


2 


3 


5 


71 


122 


193 


15 


15 


30 


11 


24 


35 


9 


29 


38 


- 


8 


8 


16 


12 


28 


3 


8 


11 


1 


2 


3 


267 


443 


710 


5 


10 


15 


6 


15 


21 


17 


39 


56 


10 


10 


20 


213 


340 


553 



FIELD READER 
QUESTIONNAIRE 



Code for 



Field Reader Questionnaire 



1 . Have you been engaged in research during any of 
the years listed below: 

1969 : 

XI 7/ 1 Research on education 

2 Research other than on education 

3 Research on education and another field 
0 Not engaged in research 

Y No answer 



1963 : 

XI 8/ 1 Research on education 

2 Research other than on education 

3 Research on education and another field 
0 Not engaged in research 

Y No answer 



1967 



XI 9/ 1 Research on education 

2 Research other than on education 

3 Research on education and another field 
0 Not engaged in research 

Y No answer 



1966 : 

XI 10/ 1 Research on education 

2 Research other than on education 

3 Research on education and another field 
0 Not engaged in research 

Y No answer 



1965 : 

XI 11/ 1 



Research on education 
Research other than on education 
Research on education and another field 
Not engaged in research 
No answer 



Total 



237 

64 

62 

58 

2 



231 

61 

75 

54 

2 



235 

65 

71 

50 

2 



227 

67 

66 

61 

2 



217 

63 

71 

70 

2 




Engaged in 


research (continued) 




1964 : 










XI 


12/ 


1 


Research on education 


207 






2 


Research other than on education 


65 






3 


Research on education and another field 


67 






0 


Not engaged in research 


82 






Y 


No answer 


2 


Have you ever 


submitted any proposals to the 




U.S. Office 


of 


Education's Regional Research Program? 




XI 


13/ 


1 


Yes 


107 






2 


No 


314 






Y 


No answer 


2 


IF YES: 


(a) 1 


How many have you submitted? 




XI 14- 


15/ 


01 


One 


56 






02 


Two 


19 






03 


Three 


14 




04 


-12 


Four or more 


17 






YY 


No answer 


3 






XX 


DNA : None submitted 


314 



(b) V/hat have the outcomes been? 
Pending 



XI 16-17/ 00 None 88 

01 One 13 

02-03 Two or three 4 

YY No answer 4 

XX DNA: None submitted 314 

Funded 

XI 18-19/ 00 Hone 36 

01 One 44 

02- 03 Two or three 19 

04-07 Four or more 6 

YY No answer 4 

XX DNA: None submitted 314 

Not funded 

XI 20-21/ 00 None 52 

01 One 35 

02 Two 12 

03- 05 Three or more 6 

YY No answer 4 

XX DNA: None submitted 314 




2B4 



/ 



3. 



Have you ever received a research grant from any 
of these sources? 



Total 



XIII 


9/ 


1 


U.S. Office of Education 


198 




10/ 


1 


Another federal agency 


155 




11/ 


1 


State or municipal government 


95 




12/ 


1 


Private foundation 


155 




13/ 


1 


Commercial organization 


42 




14/ 


1 


Your own institution 


228 




15/ 


1 


Educational organization (e.g., AAUP, 










Phi Delta Kappa) 


14 




16/ 


1 


No answer 


2 




8/ 


1 


No research grant received 


64 










(953) 


(a) 


What 


is 


your major field or specialty? 






Education 




XI 


23/ 


i 


Administration 


66 






2 


Curriculum 


28 






3 


Research and statistics 


45 






4 


Teacher training 


88 






5 


Instructional technology 


7 






6 


Special (e.g., business, adult, higher. 










comparative) 


20 




Psychology 




XI 


24/ 


1 


Deve lopmental 


8 






2 


Guidance and counseling 


13 






3 


Learning 


13 






4 


Personality 


4 






5 


Testing and measurement 


18 






6 


Educational 


8 






7 


Cl inical 


1 






9 


Other (e.g., social, experimental) 


10 




Social Science 




XI 


25/ 


1 


History 


4 






2 


Political science 


5 






3 


Sociology 


23 






9 


Other (e.g., economics, anthropology) 


11 




Other 








XI 


26/ 


4 


Math; physical; biological sciences 


15 






5 


English and language arts 


26 






6 


Music and art 


5 






7 


Profession (e.g., law, medicine) 


5 



i 



O 

ERIC 



2 ES" 



4. (b) Within your major field, do you specialize in 

any of the sub-areas listed below? 



Total 



20/ 


1 


Pre-school 


44 


21/ 


1 


Elementary 


120 


22/ 


1 


Secondary 


134 


23/ 


1 


College 


218 


24/ 


1 


Graduate 


142 


25/ 


1 


Adolescent 


31 


26/ 


1 


Adult 


52 


27/ 


1 


Vocational 


57 


28/ 


1 


Distributive 


5 


19/ 


1 


None 


79 


29/ 


1 


No answer 


16 








(898) 



5. At present, how do you divide your professional time? 

Per cent time curriculum or 
educational program development 



XI 28-29/ 01-20 131 

21-40 41 

41-60 10 

61-80 2 

81-100 3 

00 No time this area 229 

YY No answer 7 

Per cent time research 

XI 30-31/ 01-20 160 

21-40 110 

41-60 45 

61-80 19 

81-100 11 

00 No time this area 71 

YY No answer 7 

Per cent time services 

XI 32-33/ 01-20 139 

21-40 39 

41-60 7 

61-80 4 

81-100 

00 No time this area 227 

YY No answer 7 



286 



Total 

How do you divide your pro£e..sional time? (con’td) 

Per cent time teaching 

XI 34-35/ 01-20 89 

21-40 114 

41-60 72 

61-80 32 

81-100 3 

00 No time this area 106 

YY No answer 7 

Per cent time other (e.g., administration) 

XI 36-37/ 01-20 90 

21-40 70 

41-60 57 

61-80 39 

81-100 40 

00 No time this area 120 

YY No answer 7 

Are you an advisor for doctoral dissertations? 

XI 38/ 1 Yes 244 

2 No 171 

Y No answer 8 

IF YES: (a) How many dissertations are you currently 

supervising? 

XI 39-40/ 01-02 One or two 51 

03-04 Three or four 81 

05-09 Five to nine 76 

10-27 Ten or more 31 

YY No answer 13 

XX DNA: Not an advisor for doctoral 

dissertations 171 

(b) Are any of these dissertations supported 
by the USOE Regional Research Program? 

41/ 1 Yes 18 

2 No 224 

3 Don 't know 8 

y No answer 8 

X DNA: Not an advisor for doctoral 

dissertations 165 



7. 



Are you now under contract to the U .S . Office of 
Education as a field reader? 



Total 



10 . 



11 



XI 42/ 


1 Yes 




339 




2 No 




77 




Y No 


answer 


7 


In all, how 


many years have you been a field reader 




for the U .S 


. Office of Education? 




XI 43-44/ 


01-02 


One or two 


45 




03 


Three 


144 




04 


Four 


97 




05 


Five 


72 




06-13 


Six or more 


58 




YY 


No answer 


7 


Altogether, 


how many USOE proposals have you reviewed? 




XI 45-46/ 


01-05 


One to five 


80 




06-14 


Six to fourteen 


no 




15-29 


Fifteen to twenty-nine 


75 




30-90 


Thirty to ninety 


88 




99 


One hundred or more 


51 




YY 


No answer 


19 


Of these proposals 


, about how many were submitted to 




the Regional Research Program? 




XI 47-48/ 


01-03 


One to three 


68 




04-10 


Four to ten 


73 




11-40 


Eleven to forty 


53 




41-99 


Forty -one or more 


51 




YY 


Cannot recall exact number 


178 


Thinking back , would you say that the quality of the 




proposals you have 


reviewed for the Regional Research 




Program has 


changed in the following respects; 




(a) The criterion 


educational significance is more, or 




less, : 


frequently satisfied now than in the past? 




XI 49/ 1 


More 


frequently satisfied 


98 


2 


No observable change 


167 


3 


Less 


frequently satisfied 


20 


0 


No impression 


100 


Y 


No answer 


38 




282 



11. Has the quality of proposals changed? (continued) 



Total 



(b) The criterion soundness of research design is 
more, or less, frequently satisfied now than 
in the past? 

XI 50/ 1 More frequently satisfied 123 

2 No observable change 153 

3 Less frequently satisfied 26 

0 No impression 83 

Y No answer 38 

12, Do you think that a copy of the comments made by 
field readers should be sent routinely to each 
applicant? 

XI 51/ 1 Yes, comments should be sent routinely 

to all applicants 246 

2 Only to applicants who request them 84 

3 Only to applicants whose proposals 

have been rejected 5 

4 Only to applicants whose proposals 

have been funded 3 

5 No, comments should not be sent to any 

applicant 64 

0 No opinion 17 

Y No answer 4 

13, Should field readers be informed of the outcomes of 
the proposals they evaluate? 

XI 52/ 1 Yes 358 

2 No 29 

0 No opinion 35 

Y No answer 1 

14, Should the final report be reviewed by a field reader 
who recommended the project for funding? 

XI 53/ 1 Yes 214 

2 No 75 

0 No opinion 123 

Y No answer 11 



Total 



15. Tlie present USOE Evaluation Form asks the reviewer to: 

(a) Provide an overall evaluation of the proposal; 

(b) Discuss the proposal as it relates to the reviewer's 

area of specialization; and 

(c) State to what extent the proposal satisfied four 

criteria: 

(1) educational significance 

(2) soundness of research design 

(3) adequacy of personnel and facilities 

(4) economic efficiency 



Would you recommend any of the following changes in the 
Evaluation Form: 

FOR REGIONAL RESEARCH PROGRAM PROPOSALS 



Total 



XIII 33/ 1 Eliminate (b) above 87 

34/ 1 Provide a rating scale for each of the 

four criteria 143 

35/ 1 Standardize the form by using check-lists 

instead of esray-type answers 69 

36/ 1 Separate the cxiterion "adequacy of 

personnel and facilities" into two 
criteria, "adequacy of personnel" and 
"adequacy of facilities" 159 

37/ 1 Perforate the form so that comments 

recorded below the perforation could 

be sont to the anplicant, while those 

above would oe for USOE exclusively 92 

Eliminate one or more of the criteria in (c) above : 

38/ 1 Educational significance 6 

39/ 1 Soundness of research design 2 

40/ 1 Adequacy of personnel and facilities 12 

41/ 1 Economic efficiency 37 

32/ 1 None of the changes indicated in columns 

33-41 above 172 



Add other criteria to (c) above: 

44/ 1 Significance beyonu education 

45/ 1 Creativity of researcher 

46/ 1 Suitability for replication 

47/ 1 Standardize form with both check-lists 

and space for essay-type answers 
43/ 1 None of the changes indicated in 

columns 44-47 above 



76 

68 

89 

16 

262 





( 1290 ) 



15 . (continued) 



Total 



FOR ALL USOE PROPOSALS 



XIII 52/ 
53/ 

54/ 

55/ 

56/ 



1 Eliminate (b) 

1 Provide a rating scale for each of the 
four criteria 

1 Standardize the form by using check -lists 
instead of essay-type answers 
1 Separate the criterion "adequacy of personnel 
and facilities" into two criteria, "adequacy 
of personnel" and "adequacy of facilities" 

1 Perforate the form so that comments recorded 
below the perforation could be sent to the 
applicant, while those above would be for 
USOE exclusively 



Eliminate one or more of the criteria in (c) ; 



111 

207 

96 

231 



121 



57/ 1 Educational significance 10 

58/ 1 Soundness of research design 3 

59/ 1 Adequacy of personnel and facilities 11 

60/ 1 Economic efficiency 43 

31/ 1 None of the changes indicated in columns 52-60 

above 89 

Add other criteria to (c) : 

63/ 1 Significance beyond education 112 

64/ 1 Creativity of researcher 98 

65/ 1 Suitability for replication 124 

66/ 1 Standardize form with both check-lists and 

space for ess ay- type answers 18 

62/ 1 None of the changes indicated in columns 63-67 

above 203 



(1477) 




16. As you know, some proposals submitted to the Regional 

Research Program are reviewed at a panel session; others 
are reviewed only by individual field readers. On the 
average, when serving as an individual field reader how 
long has it taken you to read a proposal and to complete 
the USOE Evaluation Form? 

Total 

Average reviewing time: 



XI 


58-59/ 


01 


One hour 


52 






02 


Two hours 


105 






03 


Three hours 


78 






04 


Four hours 


61 




05 


-30 


Five to thirty hours 

Median 2.88 hours; Mean 3.49 hours 


77 






YY 


No answer 


48 






XX 


Never individual field reader 


2 


XI 


60/ 


0 


Never individual field reader 


2 



17. Have you participated in one or more panel meetings to 
review proposals for the Regional Research Program? 



XI 


61/ 1 


Yes 


115 




2 


No 


304 




Y 


No answer 


4 


IF 


YES; (a) On how many panels have you served? 




XI 


62-63/ 01 


One 


46 




02-03 


Two or three 


35 




04-20 


Four or more 


30 




YY 


No answer 


8 




XX 


DNA: Never participated in a panel 








session 


304 



(b) About how long does it take 


you to review 




a 


proposal for a panel session? 




XI 64-65/ 01 


One hour 




63 


02 


Two hours 




29 


03-12 


Three or more hours 




17 




Median 1.36; Mean 1.72 






YY 


No answer 




10 


XX 


DNA: Never participation 


in a 





panel session 




C 1 



1 



304 



Ill 



o 

ERIC 



17. Have you participated in panel meetings? (cont 'd) 



18, 



19. 



20 . 



4i 



Total 



(c) V/liat do you consider the optimum number 
of proposals for a panel to reA^iew in 
one day? 



XI 



01-10 


Ten or less 


29 


11-19 


Eleven to nineteen 


32 


20 


Twenty 


34 


21-35 


Twenty -one or more 
Median 15.09; Mean 14.85 


12 


YY 


No answer 


12 


XX 


DNA: Never participated in a 






panel session 


304 



Do you have any ideas for improving the review process -- 
either by panel or by mail? 



Less than five per cent of the respondents answered 
Question 18, because questions 12 through 15 anticipated 
their suggestions about improving the review process . 

As a result, the few suggestions offered have not been 
listed here . 



On balance, which system of review do you think yields 
better evaluations of Regional Research Program proposals; 
(a) proposals reviewed at a panel session? (b) those 
reviewed by correspondence? 



XI 


71/ 1 


At a panel session 


133 




2 


By correspondence 


27 




0 


Can't compare the two 


238 




Y 


No answer 


25 


In 


addition 


to being a field reader, have you ever been 




a 


consultant to USOE? 




XI 


72/ 1 


Yes 


216 




7 


No 


169 




0 


Cannot recall 


31 




Y 


No answer 


7 



r> 




Total 



21 , Have you ever reviewed proposals for a granting agency 
other than USOE? 



XII 7/ 1 Yes 307 

2 No 98 

0 Cannot recall 17 

Y No answer 1 

IF YES: (a) For what type of agency? 

XIII 68/ 1 Another federal agency 145 

69/ 1 State or municipal government 102 

70/ 1 Private foundation 120 

71/ 1 Professional association 110 

72/ 1 Educational consortium 49 

73/ 1 Own institution 201 

74/ 1 Foreign (e.g., Canadian government) 6 

75/ 1 Commercial organization 5 

76/ Y No answer 1 

77/ X DNA: Has not reviewed proposals for 

other granting agency 115 



(854) 

IF YES: (b) Do you think that the quality of proposals 

submitted to USOE is better, about the 
same, or not as good as other proposals 
you have reviewed? 



XII 9/ 1 Proposals submitted to USOE are better 50 

2 About the same 160 

3 Not as good as others 57 

0 Not comparable 35 

Y No answer 6 

X DNA: Has not reviewed proposals for 

other granting agency 115 



22. Have you ever been an editorial consultant for a 
scientific journal? 



XII 10/ 1 Yes 239 

2 No 174 

0 Cannot recall 1 

Y No answer 9 




^9 






23. Are you a member of any national professional societies? 



Total 



XII 11/ 1 Yes 

2 No 

Y No answer 

IF YES; Please name the two which are of greatest value 
to you . 

XII 12-14/ For detailed listing of first named 

professional societies, see Appendix B. 

Subject classification of FIRST named professional society. 



XII 75-76/ 10 Physical education, health, recreation 6 

11 Educational administration 9 

12 Curriculum 7 

13 Research and statistics 110 

15 AV and instructional technology 5 

16 Special education (e .g . , adult, 

international , higher) 16 

17 Classroom teaching 25 

18 Vocational and applied arts (e.g., 

industrial arts , home economics , 
agriculture) 17 

20 General psychology 53 

21 Developmental 2 

22 Guidance and counseling 12 

25 Testing and measurement 1 

28 Exceptional children 2 

31 Sociology 21 

32 Political science 4 

33 History 4 

34 Other social science Ce.g., anthropology, 

economics) 20 

35 Math; physical, biological sciences 21 

36 English and language arts 30 

37 Music and art 23 

38 Other profession (e.g., law, medicine) 2 

39 Profession as a role (e.g., AAUP); 

honorary society (Phi Delta Kappa) 12 

YY No answer 18 

XX DNA: Not a members of a national 

professional society 3 



O 




A 



415 

3 

5 



2DS 



23. Member of national professional societies? (cont'd) 



Total 



XII 15-17/ For detailed listing of second named 

professional societies, see Appendix B. 

Subject classification of SECOND named professional society. 



XII 77-78/ 10 Physical education, health, recreation 5 

11 Educational administration 17 

12 Curriculum 7 

13 Research and statistics 74 

14 Teacher training 1 

15 AV and instructional technology 2 

16 Special education (e.g., adult, 

international , higher) 20 

17 Classroom teaching 26 

18 Vocational and appli d arts (e.g., 

industrial arts, home economics, 
agriculture) 13 

20 General psychology 36 

21 Developmental 3 

22 Guidance and counseling 11 

25 Testing and measurement 7 

26 Educational Psychology 1 

28 Exceptional children 6 

31 Sociology 5 

32 Political science 4 

33 History 2 

34 Other social science (e.g., anthropology, 

economics) 36 

35 Math; physical; biological sciences 21 

36 English and language arts 18 

37 Music and art 14 

38 Other profession (e.g., law, medicine) 5 

39 Profession as a role (e.g., AAUP) ; 

honorary society (e.g.. Phi Delta Kappa) 36 
YY No answer 50 

YY DNA: Not a member of a national 

professional society 3 



24. At present, are you an officer of an academic or 
professional society? 

XII 18/ 1 Yes 

2 No 

Y No answer 

IF YES: Name of society 

XII 19-21/ For detailed listing of professional societies in 
which respondents are officers, see Appendix B. 



144 

275 




24. 



(Continued) 



Total 



Subject classification of societies in which respondents 
are officers . 



XII 10 Physical education, health, recreation 5 

11 Educational administration 4 

12 Curriculum 3 

13 Research and statistics 12 

14 Teacher training 1 

15 AV and instructional technology 2 

16 Special education (e.g., adult, 

intf.mational , higher) 7 

17 Classroom teaching 17 

18 Vocational and applied arts (e.g., 

industrial arts, home economics, 
agriculture) 10 

20 General psychology 9 

22 Guidance and counseling 1 

26 Educational psychology 1 

28 Exceptional children 2 

31 Sociology 9 

32 Political science 3 

33 History 1 

34 Other social science (e.g., anthropology, 

economics) 10 

35 Math; physical, biological sciences 4 

36 English and language arts 13 

37 Music and art 15 

38 Other profession (e.g., law, medicine) 1 

39 Profession as a role (e.g., AAUP) ; 

honorary society (e.g.. Phi Delta Kappa) 9 
YY No answer 9 

RR DNA: Not an officer of an academic 

or professional society 275 



25 . Within the last two years have you attended a meeting of 
an academic or professional society? 

415 
3 
5 



XII 



22 / 



1 

2 

Y 



Yes 

No 

No answer 




Total 



26. How many research studies (articles, monographs, or 
books) have you published, and what was the date of 
your first publication? 

Articles 



XII 


23-24/ 01 




7 




02 




17 




03 




19 




04 




18 




05-10 




86 




11-25 




107 




26-99 




125 




00 


Published but not articles 


9 




YY 


No answer 


7 




XX 


DNA; Has not published any 








research studies 


28 


Monographs 






XII 


25-26/ 01 




47 




02 




60 




03-04 




52 




05-10 




42 




11-50 




31 




00 


Published but not monographs 


156 




YY 


No answer 


7 




XX 


DNA: Has not published any 








research studies 


28 


Books 






XII 


27-28/ 01 


One 


63 




02 


Two 


46 




03-05 


Three to five 


58 




06-30 


Six or more 


29 




00 


Published but not books 


192 




YY 


No answer 


7 




XX 


DNA: Has not published any 








research studies 


28 



298 



26. (Continued) 



Total 



Date of first publication 



XII 29-30/ 



1968-1970 
1964-1967 
1960-1963 
1956-1959 
1950-1955 
1940-1949 
Prior to 1940 
YY No answer 

XX DNA: Has not published any 

research studies 



3 

44 

65 

70 

89 

64 

44 

16 

28 



XII 31/ 0 No research studies published 

Y No answer 

X DNA: At least one publication 



28 

5 

390 



27. 



Would you describe your research interest as mainly 
basic or applied? 

XII 32/ 1 Basic 

2 Applied 

3 Both basic and applied 
Y No answer 



88 

269 

48 

18 



28. Some researchers interested in education seek mainly to 
achieve rec.'gnition from behavioral scientists outside 
the. field of education, while others are primarily con- 
cerned with being recognized by researchers within 
education or by school practitioners. I'l/hich group's 
judgment is most important to you personally? 

XII 33/ 1 Researchers within education 

2 Researchers outside education 

3 School practitioners 
0 None of these 

Y No answer 



144 

122 

91 

36 

30 



299 



Total 



29. Tlirough a variety of sources, researchers get an overall 
irapression cf funding agencies. Is it your current 
impression t'nat the Regional Research Program is limited 
to a few areas of special interest, or does it cover a 
broad range of interests in education? 



XII 34/ 1 


Few areas of special interest 


71 


2 


Broad range of interests 


177 


0 


No impression 


163 


Y 


No answer 


10 



Do you think 
tends to be 
research? 


that the USOE Regional Research Program 
orthodox or venturesome in its support of 




XII 35/ 1 


Orthodox; more likely to support 






established lines of research 


164 


2 


Venturesome; willing to take risks in 






developing new lines of research on 
education 


87 


0 


No opinion 


161 


Y 


No answer 


11 



31 . As far as departures from the original proposal are con- 
cerned, is it your opinion that the Regional Research 
Program tends to be fairly strict or somewhat permissive? 



XII 36/ 1 


Fairly strict 


75 


2 


Fairly permissive 


98 


0 


No opinion 


239 


Y 


No answer 


11 



Do you think 


that the Regional Research Program should 




encourage the researcher to investigate certain definite 




areas Ce.g., 


reading), or should it encourage him to 




develop his 
education? 


own area of interest within the field of 




XII 37/ 1 


Encourage researcher to investigate certain 






definite areas 


73 


2 


Encourage researcher to develop his own 






interest 


261 


3 


No opinion 


54 


Y 


No answer 


35 



300 



Total 



33. In comparing procedures that an applicant must follow 
when submitting a proposal to the Regional Research 
Program with those required by other agencies , would you 
say that the Regional Research Program involves more, 
about the same, or somewhat less "red tape"? 

XII 38/ 1 More "red tape" 43 

2 About the same amount 155 

3 Somewhat less "red tape" 83 

0 No opinion 131 

Y No answer 11 

34. Some researchers view the regulation requiring clearance 
of educational data -gathering instruments as a good idea, 
whereas others regard it as an unwarranted intrusion by 
USOE . V\!hat is your opinion, if any? 

XII 39/ 1 Good idea 172 

2 Unwarranted xntrusion 122 

0 No opinion 102 

Y No answer 27 

35. Have you ever submitted any data-gathering instruments to 
USOE for clearance? 

XII 40/ 1 Yes 109 

2 No 306 

Y No answer 8 

36. As you may know, it is standard practice for the USOE to 
withhold a fixed percentage of a grant until the final 
report has been approved . Do you think this is a good 
idea? 

XII 41/ 1 Agree with this practice 319 

2 Disagree with it 57 

0 No opinion 37 

Y No answer 10 



Total 



o7. A stated goal of the Regional Research Program is; 

"To encourage small colleges to undertake 
research programs so that students may 
benefit from, having professors who are 
engaged in educational research activities." 

Do you think that this goal should be empha.sized more, 
about the same, or less than it is now? 



XII 42/ 1 More 



2 About the same 

3 Less 

0 No opinion 
Y No answer 



164 

112 

72 

60 

15 




Total 



38. The present ceiling on funds for proposals submitted 
to the Regional Research Program is $10,000. What 
do you think the ceiling on funds should be? 



XII 43-45/ $ 5,000 4 

(entered as 7,500 1 

hundreds of 3,000 2 

dollars) 10,000 138 

11,000 1 

12,000 6 

12,500 4 

15.000 53 

20.000 63 

25.000 60 

30 .000 4 

40.000 .1 

50.000 10 

999 Recommends no ceiling 7 

YYY No answer 69 

MEDIAN $15,000 



Please comment on your preference as to what the 
ceiling on RRP funds should be. 



Raise ceiling: 



XII 



46 or 47/ 



1 To allow for inflationary increase 

in costs 

2 To permit greater flexibility in 

research design 

4 To provide higher salaries for 

research and clerical staff and 
obtain necessary equipment 
6 To strengthen the program in general 



67 



37 

21 

5 



Lower ceiling : 

XII 47/ 5 Applicant’s institution should 

match funds, if necessary 4 



No change : 

XII 47/ 3 Present ceiling adequate for small 

project research 57 




303 



'38, Ceiling on RRP funds (continued) Total 

Other : 

XII 47/ 7 No ceiling. Nature of project should 

determine amount of grant 1 

46 or 47/ 8 Other (e,g., no amount specified, but 

prefers moderate grants to many 
rather than large grants to a few) 3 



YY No answer 



240 



39, Listed below are some possible advantages of being a 
field reader for the Regional Research Program, 
Indicate those that apply to you personally. 



XII 54/ 

55/ 

56/ 

57/ 

58/ 

59/ 

60/ 

61/ 

62/ 

53/ 

63/ 



1 Acquisition of 'intelligence' about 
USOE granting practices 
1 Contact with educational researchers 
from other institutions 
1 Contact with USOE officials 
1 Exposure to new research ideas 
1 Intellectual stimulation 
1 Opportunity to contribute ideas to 
young researchers 

1 Opportunity to influence research 
on education 

1 Professional prestige 
1 Other (e.g,, opportunity to perform 
a public service) 

1 Perceives no professional advantage 
1 No answer 



181 

164 

138 

307 

268 

166 

239 

90 

25 

7 

23 



Additional comments, either positive or negative, about 
the Regional Research Program 



Total 



Positive comments : 

XII 50/5; 

51/0 Basically a sound program 50 



Negative comments: 



XII 


51/9 


Poorly administered 


13 




51/4, 5 


Inadequate remuneration for field readers 


27 


Recommendations 






XII 


49/4; 

50/4 


Program should have more funds 


16 




49/2; 
50/1, 2 


Improve contact between field readers 





and regional office 26 







Give 


greater emphasis to; 




50/7; 










51/7, 


8 


(1) 


Practical implications of research 


19 


49/1, 


6; 








50/3, 


6; 








51/2, 


3 


(2) 


Supporting good young researcliers 


13 


51/1 




Little or no knowledge of program 


24 


49-51/YYY 


No answer 


271 



(459) 




30jr 



Code for 



Field Reader Background Data* 



1. Institution from which earned a degree 
(FIRST named) 



Non- 

Respondent Respondent 



XIV 7-12/ See Nash college file (EASR 
#81050) for e '.plicit insti- 
tutional ID. First tv^;o digits 
of Nash college file identify 
state in which institution 
located. See Appendix C for 
listing of states. 

YYYYYY No answer 32 13 



2. Earned degree (first named institution) 



XIV 13/ 1 BA; PhB 4 

2 MA; MBA 19 

3 M.Ed. 2 

4 Ed.D. 104 

5 Ph.D. 251 

6 BS; BBA 2 

7 MS 4 

8 Other doctorate (e.g., 

business , theology, music) 4 

9 Professional degree 

(e.g., MD, DDS) 2 

0 Educational specialist or 

professional diploma 1 

Y No answer 30 



2 

1 

13 

43 

1 



13 



3. Year of degree (first named institution) 



XIV 14-15/ 



1924 - 1939 
1940 - 1949 
1950 - 1954 
1955 - 1959 
1960 - 1964 
1965 - 1968 

YY No answer 



35 


3 


58 


12 


76 


16 


88 


15 


75 


9 


26 


3 


65 


17 



Source ; 



Office of Education, Bareau of Research, Field Reader catalogs. 



Major field (first named degree) 



Respondent 



Non- 

Respondent 



XIV 16-17/ 



10 


Physical education , 
health , recreation 


4 




11 


Educational administration 


25 


2 


12 


Curri culum 


7 


2 


13 


Research and statistics 


9 


- 


14 


Teacher training 


13 


1 


16 


Special education (e.g., 
adult, higher, inter- 
national) 


15 


1 


17 


Primary or secondary 
education 


9 




18 


Vocational and applied 
arts (e.g., technical, 
distributive, industrial 
arts) 


12 


1 


19 


Education: not specified 


19 


3 


20 


General psychology 


22 


4 


21 


Developmental 


1 


- 


22 


Guidance and counseling 


4 


4 


23 


Learning 


- 


1 


25 


Testing and measurement 


4 


1 


26 


Educational psychology 


34 


6 


27 


Clinical psychology 


2 


- 


31 


Sociology 


17 


1 


32 


Political science 


3 


1 


33 


History 


2 


- 


44 


Other social science (e.g., 
economics , anthropology) 


10 


2 


55 


Math; physical;, biological 
sciences 


19 


2 


66 


English and language arts 


15 


10 


77 


Music and art 


10 


- 


88 


Other profession (e.g., 
law, medicine) 


3 


_ 


YY 


No answer 


164 


33 



Respondent 



Institution from which earned a degree 
(SECOND named) 



XIV 18-23/ 



See Nash college file (BASR 
#B1050) for explicit insti- 
tutional ID. First two digits 
of Nash college file identify 
state in which institution 
located. See .Appendix C for 
listing of states . 

YYYYYY No answer 



XXXXXX DNA : 



No second named 
institution 



43 



Non- 

Respondent 



16 



6. Earned degree (second named institution) 
XIV 24/ 



1 


BA; PhB 


34 


8 


2 


MA; MBA 


205 


34 


3 


M.Ed. 


43 


2 


6 


BS; BBA 


23 


2 


7 


MS 


69 


14 


9 


Professional degree 








(e.g., MD, DDS) 


1 


- 


Y 


No answer 


41 


15 


X 


DNA: No second named 








institution 


7 


- 



7. Year of degree (second named institution) 



1918 - 1934 


36 


4 


1935 - 1944 


62 


11 


1945 - 1949 


61 


14 


1950 - 1954 


89 


13 


1955 - 1959 


67 


6 


1960 - 1964 


21 


5 


YY No answer 


80 


22 


XX DNA; No second named 
institution 


7 


_ 







3. Major field (second named degree) 
XIV 27-28/ 



Respondent 



Non- 

Respondent 



10 


Physical education, 
health, recreation 


3 




11 


Educational administra- 
tion 


22 


2 


12 


Curri culum 


1 


1 


14 


Teacher training 


11 


2 


16 


Special education (e.g., 
adult, higher, inter- 
national) 


7 




17 


Primary or secondary 
education 


11 


1 


18 


Vocational and applied 
arts (e.g., technical, 
distributive, industrial 
arts) 


23 


1 


19 


Education not specified 


20 


2 


20 


General psychology 


25 


5 


21 


Developmental 


3 


- 


22 


Guidance and counseling 


10 


2 


23 


Learning 


- 


1 


26 


Educational psychology 


22 


6 


27 


Clinical psychology 


1 


- 


31 


Sociology 


9 


- 


32 


Political science 


4 


1 


33 


History 


4 


- 


44 


Other social science (e.g., 
economics, anthropology) 


11 


2 


55 


Math; physical; biological 
sciences) 


27 


3 


66 


English and language arts 


13 


12 


77 


Music and art 


10 


- 


88 


Other profession (e.g., 
law, medicine) 


2 




YY 


No answer 


177 


34 


XX 


DN,\: No second named 

degree 


7 






Non- 

D. Institution from which earned a degree Respondent Respondent 
(THIRD named) 

XIV 29-34/ See Nash college file (BASR 
#31050) for explicit insti- 
tutional ID. First two digits 
of Nash college file identify 
state in which institution 
located. See Appendix C for 
listing of states. 





YYYYYY No answer 

XXXXXX DNA: No third named 


52 


15 


institution 

Earned degree (third named institution) 


57 


8 


XIV 


35/ 1 BA; PhB 


182 


29 




2 MA; MBA 


6 


2 




6 BS ; BBA 


124 


20 




7 MS 


2 


1 




Y No answer 
X DNA: No third named 


52 


15 


Year 


institution 

of degree (third named institution) 


57 


8 


XIV 


36-37/ 1919 - 1934 


43 


7 




1935 - 1939 


41 


7 




1940 - 1944 


33 


8 




1945 - 1949 


57 


9 




1950 - 1954 


75 


7 




1955 - 1962 


29 


8 




Y'/ No answer 

XX DNA : No third named 


87 


21 




institution 


57 


8 




3/0 



Non- 



12 . 



XIV 38-39/ 



(third named degree) 


Respondent 


Respon( 


10 


Physical education, 
health, recreation 


1 




11 


Educational administra- 
tion 


2 


1 


12 


Curriculum 


2 


- 


14 


Teacher training 


7 




16 


Specio.l education (e.g., 
adult, higher, inter- 
national) 


3 




17 


Primary and secondary 
education 


7 


2 


18 


Vocational and applied 
arts (e.g., te'.’inical, 
distributive, indus- 
trial arts) 


22 


3 


19 


Education not specified 


13 


1 


20 


General psychology 


23 


6 


26 


Educational psychology 


3 


- 


31 


Sociology 


5 


- 


32 


Political science 


2 


1 


33 


History 


11 


- 


44 


Other social science 
e.g.^ economics, 
anthropology) 


13 




55 


Math; physical; biolog- 
ical sciences 


43 


5 


66 


English and language arts 


25 


10 


77 


t'lusic and art 


14 


T 

i. 


88 


Other profession (e.g. , 
law, medicine) 


1 




YY 


No answer 


169 


35 


XX 


DNA; No third named 
degree 


57 


8 





1 



13. Present position 



Non - 

Respondent Respondent 



XIV 40-41/ 



00 


Research director or 
research specialist 


29 


5 


10 


Departmental chairman 


18 


3 


11 


Full professor 


182 


29 


12 


Associate professor 


45 


6 


13 


Assistant professor 


15 


2 


14 


Other faculty (e.g., 
adjunct, lecturer) 


10 


1 


30 


Administrative officer 
(e.g., vice-president 
of university develop- 
ment, dean, executive 
secretary) 


70 


10 


40 


Program director (e.g., 
director, program of 
student development!, 
director, recreation 
and youth council) 


16 


4 


50 


Counselor or consultant 


3 


1 


80 


School administrator 
(below college level) 


8 


- 


YY 


No answer 


26 


14 


XX 


Retired 


1 


- 



14. Institutional affiliation 

XIV 42-47/ See Nash college file (BASR 
#B1050) for explicit insti- 
tutional ID. First two digits 
of Nash college file identify 
state in which institution 



located 


. See Appendix C for 






listing 


of states . 






YYYYYY 


None indicated 


18 


11 


XXXXXX 


Not an institution of 
higher education 


57 


13 





15. Year of employment at this institution Respondent 



Non- 

Respondent 



1952 


69 


9 


1960 


79 


19 


1964 


86 


9 


1966 


71 


16 


1968 


70 


9 


answer 


48 


13 



L6. Case identification 
XIV 78/ 0 



Removed from questionnaire 
sanqjle- -expired or out 
of country 



5 Non-respondent 



75 





3 



PROPOSAL CONTENT 
(Respondent Section) 



Code for 



Proposals Submitted to USOE Regional Research Program in FY 



Not 

Funded Funded 

GROUP TO BE STUDIED 



XXIV 8/ 1 Community 

XXII 5/ 1 Explicit sample size 

2 Approximate sample size 
Y Not specified 

9-13/ Number of cases in sample: 

One 

Two 

Five 

Fourteen 
Thirty-five 
YYYYY Not specified 




XXIV 9/ 1 Parents 



XXII 14/ 1 

2 
Y 



Explicit sa’inple size 
Approximate sample size 
Not specified 



15-19/ Number of cases in sample: 



Five 

Fifty 

One hundred 
Fourteen thousand 
YYYYY Not specified 




XXIV 10/ 1 School Board 



XXII 20/ 1 

2 
Y 



Explicit sample size 
Approximate sample size 
Not specified 



1 



1 



'68 



Total 



9 

7 

1 

1 



3 

2 

1 

1 

1 

1 



5 

2 

2 

1 



1 

1 

1 

1 

1 



1 



1 



31S 











Not 










Funded 


Funded 


Total 


XXIV 11/ 


1 


School District 


3 


3 


6 


XXII 26/ 


1 


Explicit sample size 


1 


2 


3 




2 


Approximate sample size 


- 


1 


1 




Y 


Not specified 


2 


- 


2 


27-31/ 


Number of cases in sample; 












One 


1 


- 


1 






Six 


- 


2 


2 






Eight 


- 


1 


1 


YYYYY 


Not specified 


2 


- 


2 



XXIV 


12/ 


1 


School 


12 


20 


32 


XXII 


32/ 


1 


Explicit sample size 


11 


11 








2 


Appioximate sample size 


1 


- 


1 






Y 


Not specified 


- 


9 


9 


31 


-37/ 


Number of cases in sample : 














1 


1 


1 


2 








3 or 4 


2 


6 


8 








6 to 12 


2 


2 


4 








20 to 49 


5 


1 


6 








50 to 151 


2 


1 


3 




YYYYY 


Not specified 


- 


9 


9 



XXIV 


13/ 


1 


Principals 


5 


11 


16 


XXII 


38/ 


1 


Explicit sample size 


2 


2 


4 






2 


Approximate sample size 


- 


- 


- 






Y 


Not specified 


3 


9 


12 


39 


-43/ 


Number of cases in sample : 














6 


1 




] 








16 


1 


- 


1 








50 


- 


1 


1 








800 


- 


1 


1 




YYYYY 


Not specified 


3 


9 


12 











Not 










Funded 


Funded 


Total 


XXIV 14/ 


1 


Other administrators 


10 


31 


41 


XXII 44/ 


1 


Explicit sample size 


2 


5 


7 




2 


Approximate sample size 


4 


8 


12 




Y 


Not specified 


4 


18 


22 


45-49/ 


Number of cases in sample: 












12 to 50 


1 


4 


5 






75 to 150 


1 


4 


5 






152 to 208 


2 


2 


4 






300 to 1000 


2 


3 


5 


YYYYY 


Not specified 


4 


18 


22 



XXIV 15/ 


1 


Students 


149 


228 


377 


XXII 50/ 


1 


Explicit sample size 


40 


44 


84 




2 


Approximate sample size 


60 


105 


165 




Y 


Not specified 


49 


79 


128 


51-55/ 


Number of cases in sample : 












6 to 50 


19 


30 


49 






51 to 100 


14 


35 


49 






101 to 200 


27 


25 


52 






201 to 500 


21 


32 


53 






501 to 3000 


13 


24 


37 






5000 to 22000 


6 


3 


9 


YYYYY 


Not specified 


49 


79 


128 


XXIV 16/ 


1 


Teachers 


24 


53 


77 


XXII 56/ 


1 


Explicit sample size 


6 


6 


12 




2 


Approximate sample size 


5 


18 


23 




Y 


Not specified 


13 


29 


42 


57-61/ 


Number of cases in sample: 












5 to 50 


2 


11 


13 






51 to 150 


6 


5 


11 






200 to 600 


1 


4 


5 






1200 to 3500 


2 


4 


6 


YYYYY 


Not specified 


13 


29 


42 




31 / 













Not 












Funded 


Funded 


Total 


XXIV 


7/ 


1 


Guidance counselors 


2 


4 


6 


XXII 


62/ 


1 


Explicit sample size 






- 






2 


Approximate sample size 


1 


2 


3 






Y 


Not specified 


1 


2 


3 


67) 


-67/ 


Number of cases in sample: 














10 


1 




1 








32 


- 


1 


1 








1250 


- 


1 


1 




YYYYY 


Not specified 


1 


2 


3 



XXIV 17/ 


1 


Other (e.g., employers. 












citizens, taxpayers) 


34 


48 


82 


XXII 68/ 


1 


Explicit sample size 


15 


11 


26 




2 


Approximate sample size 


5 


11 


16 




Y 


Not specified 


14 


26 


40 


69-73/ 


Number of cases in sample: 












1 to 20 


6 


6 


12 






21 to 70 


4 


4 


8 






90 to 300 


8 


6 


14 






350 to 1600 


2 


6 


8 


YYYYY 


Not specified 


14 


26 


40 



XXIV 18/ 
If Students 


X Not applicable 

; to be Studied : 

(a) Race or ethnic group: 


39 


83 


122 


XXIV 20/ 


1 


Caucasian 


14 


14 


28 


21/ 


1 


Negro 


14 


13 


27 


22/ 


1 


Oriental 


2 


4 


6 


23/ 


1 


American Indian 


3 


2 


5 


24/ 


1 


Chinese 


- 


1 


1 


25/ 


1 


Japanese 


- 


1 


1 


26/ 


1 


Mexica .1 •American 


1 


2 


3 


27/ 


1 


Foreign - other 


2 


7 


9 


28/ 


1 


Not specified 


137 


204 


341 


29/ 


1 


Not applicable 


92 

265 


176 

4Z4 


268 

689 



o 

ERIC 

MMlilBIffTlTLiU 






Not 




Funded 


Funded 


Total 



If Students to be Studied (continued) 





(b) 


Economic group: 








XXIV 32/ 


1 


Welfare or poverty 


14 


12 


26 


33/ 


1 


Low income 


14 


14 


28 


34/ 


1 


Middle income 


11 


15 


26 


35/ 


1 


Upper income 


4 


1 


5 


56/ 


1 


Not specified 


133 


206 


339 


37/ 


1 


Not applicable 


92 


176 


268 










424 


69l 



SUBJECT MATTER 








XX n 76/ 


1 


Agriculture 


3 


3 


6 




2 


Art (manual — graphics. 












painting, sculpture) 


5 


5 


10 




3 


Building design 


1 


- 


1 




4 


Business 


2 


5 


7 




5 


Education (administration. 












finance, history of, philos- 
ophy of; teacher training) 


65 


101 


166 




6 


English (rhetorical arts-- 












cinema, literature, speech, 
theatre) 


14 


23 


37 




7 


Foreign languages and 












linguistics 


2 


10 


12 




8 


Home economics 


2 


3 


5 




9 


Industrial arts 


3 


3 


6 




0 


Information processing (data 












retrieval systems, library) 


8 


12 


20 


77/ 


1 


Mathematics and statistics 


16 


21 


37 




2 


Music 


11 


17 


28 




3 


Physical education, health, 












and recreation (dancing) 


7 


17 


24 




4 


Physiological measurements 


2 


3 


5 




5 


Psychology (educational. 












personality, school, testing 
and measurement, counseling, 
guidance and placement) 


71 


122 


193 




6 


Reading 


15 


15 


30 




7 


Science (biological, environ- 












mental, or physical) 


11 


24 


35 




8 


Social science (area studies , 












economics, geography, history, 
international relations, 
political science) 


9 


29 


38 











Not 








Funded 


Funded 


Total 


SUBJCCT MATTER (continued) 








9 


Speech pathology and audiology 


- 


8 


8 


Y 


Behavioral science research , 










environmental focus 


16 


12 


28 


0 


Subject not elsewhere classified 








(e.g. .Headstart, aviation) 


3 


8 


11 


X 


Not classifiable by subject 


1 


2 






(e.g., student activism) 


267 


443 


710 



INSTRUCTIONAL 


METHODS 








XXII 78/ 1 


Computer assisted 


5 


10 


15 


2 


Programmed 


6 


15 


21 


3 


Audio-visual 


17 


39 


56 


Y 


No instructional method 










indicated 


10 


10 


20 


X 


Not applicable 


213 


340 


553 



EDUCATIONAL ; 


LEVEL (S) TO BE STUDIED 








XXIV 39/ 


1 


Pre-school 


16 


18 


34 


40/ 


1 


Elementary (grade specified 












below) 


54 


83 


142 


41/ 


1 


Secondary (grade specified 












below) 


49 


94 


143 


42/ 


1 


Junior college (grade 












specified below) 


15 


15 


30 


43/ 


1 


College (grade specified 












below) 


71 


122 


193 


44/ 


1 


Graduate 


4 


9 


13 


45/ 


1 


Entire school system 


5 


2 


7 


46/ 


1 


Vocational and 










Applied Arts 


12 


14 


26 


48/ 

49/ 


1 

1 


Not specified 
Does not apply 


19 

36 

287 


40 

53 

460 


59 

89 

747 















Not 












Funded 


Funded 


Total 


EXPLICIT GRADE (S) TO BE STUDIED 








XXIV 


51/ 


1 


All primary grades (1-6) 


- 


1 


1 




52/ 


1 


First 


10 


16 


26 




53/ 


1 


Second 


9 


19 


28 




54/ 


1 


Third 


13 


21 


34 




55/ 


1 


Fourth 


20 


20 


40 




56/ 


1 


Fifth 


19 


23 


42 




57/ 


1 


Sixth 


25 


22 


47 




58/ 


1 


Seventh 


8 


25 


33 




59/ 


i 


Eighth 


8 


19 


27 




60/ 


1 


Ninth 


10 


18 


28 




62/ 


1 


Tenth 


15 


13 


28 




63/ 


1 


Eleventh 


12 


16 


28 




64/ 


]. 


Twelfth 


14 


15 


29 




65/ 


1 


Ail secondary grades (7-12) 


1 


3 


4 




66/ 


1 


Freshman (college) 


18 


31 


49 




67/ 


1 


Sophomore (college) 


14 


13 


27 




68/ 


1 


Junior (college) 


8 


6 


14 




69/ 


1 


Senior (college) 


10 


13 


23 




70/ 


1 


Elementary grade not specified 


52 


91 


143 




71/ 


1 


Higher grade rot specified 


98 


181 


279 




72/ 


1 


Elementary grades not 














applicable 


147 


241 


388 




73/ 


1 


Higher grades not applicable 


102 


162 


264 










613 


969 


1582 


STUDY 


DESIGN, 


METHODOLOGY 








XXV 


8/ 


1 


Developmental (not research. 














per se) 


34 


67 


101 




9/ 


1 


Documentary (content analysis 














of data collected for other 
purposes) 


36 


46 


82 




10/ 


1 


Experiment, quasi -experiment 


98 


135 


253 




11/ 


1 


Participant and non -partici- 














pant observation 


32 


59 


91 




12/ 


1 


Secondary analysis 


11 


8 


19 




13/ 


1 


Sociometry 


1 


3 


4 




14/ 


1 


Standardized achievement or 














psychological tests 


82 


126 


208 




15/ 


1 


Survey (questionnaires , inter- 














views, etc.) 


89 


138 


227 




16/ 


1 


Tests developed for study 














(aptitude, personality, 
achievement, etc.) 


74 


107 


181 




17/ 


1 


Other (e.g., follow-up panel. 














cost-benefit) 


13 


17 


30 




18/ 


1 


Not specified 


3 


4 


•n 

/ 




19/ 


1 


Not applicable 


_1 


6 


7 








' 474 ' 


716 


1190 




321 











Not 










Funded 


Funded 


Total 


mode;; of analysis 








XXV 21/ 


1 


Analysis of covariance 


20 


28 


48 


22/ 


1 


Analysis of variance 


66 


64 


130 


27>t 


1 


Correlation or regression 












analysis 


51 


65 


116 


24/ 


1 


Descriptive -nonanaly tic 












analysis 


30 


50 


80 


2S! 


1 


Discriminant function 












analysis 


5 


4 


9 


26/ 


1 


Factor analysis; cluster 












analysis 


15 


17 


32 


27/ 


1 


Qualitat've or historical 












analysis 


30 


39 


69 


28/ 


1 


Tests of significance 












(t tests, chi-square, 
nonparametric, etc.) 


55 


82 


137 


29/ 


1 


Other (e.g., item analysis. 












systems analysis , Duncan 's 
Range Test) 


7 


15 


22 


30/ 


1 


Not specified 


54 


115 


169 


31/ 




Not applicable 


-23 


54 


77 












889 



MODES OF COMPUTATION AND DATA PROCESSING 








XXIII 12/ 1 


Computer 


138 


195 


333 


9 


Other (e.g., McBee cards , 










hand tabulating) 


2 


5 


7 


Y 


Not specified 


84 


162 


246 


X 


Not applicable 


27 


50 


77 



OUTCOME OF 


RFFEARCH 








XXIII 13/ 


1 


Book 


15 


18 


33 




2 


Part of book 


1 


2 


3 




Y 


Not specified 


235 


392 


627 


14/ 


Number of journal articles: 










1 


One 


7 


15 


22 




2 


Two 


1 


2 


3 




3 


Three 


- 


1 


1 




4 


Four 


- 


1 


1 




9 


Plans articles , no number 












specified 


87 


105 


192 




Y 


Not specified 


156 


288 


444 















Not 




OUTCOME OF 


RESEARCH (continued) 


Funded 


Funded 


Total 


XXIII 15/ 


1 


Research report (other than 












progress or final report) 


10 


29 


39 




Y 


Not specified 


241 


3C5 


624 


16/ 


1 


Dissertation 


22 


29 


51 




Y 


Not specified 


229 


3C3 


C12 


17/ 


1 


Report at professional 












meeting 


25 


35 


60 




2 


Inservice educational 












program 


6 


10 


16 




3 


Report at professional 












meeting and inservice 
educational program 


1 


3 


4 




4 


Report at professional 












meeting and other (exam- 
ples listed below) 


2 


10 


12 




5 


Inservice educational pro- 












gram and other (examples 
listed below) 


7 


1 


3 




9 


Other (e.g., course modifi- 









cations, listing of library 
serials, project informa- 
tion inventory, bibliography 
of dissertations , historical 
materials, model for salary 
determination, guide for 
reading program, educational 



television program) 


70 


113 


183 


Y No outcome specified in 








Columns 13-17 


70 


148 


218 


X Some outcome specified (at 








least one numerical punch 








in columns 13-16. If 17/1-9 








not included here, because 








appears above) 


75 


92 


167 



PROJECT TO BE CONDUCTED 


XXIII 18/ 1 Within a research bureau 


19 


13 


32 


2 With assistance of a 


research bureau 


12 


24 


36 


R,Y Not specified 


220 


374 


594 



O 

ERIC 




BUDGET (AMOUNTS RECORDED IN 
TENS OF DOLLARS) 





Not 




Funded 


Funded 


Total 



Deck and colui.^. ''ocation of budget items: 



XXIII 22-24/ 


Total non-professional 


25-27/ 


Employee benefits 


28-30/ 


Trave 1 


31-33/ 


Supplies and materials 


34-36/ 


Communications 


37-39/ 


Services (test, final report 
duplication) 


40-42/ 


Equipment 


43-45/ 


Other direct costs 


46-49/ 


Sub-total direct costs 


50-53/ 


Indirect costs 


61-65/ 


Total local contribution 


XIII 19/21/ 


Total professional 



9 



$50 to $2,994 
$2,995 to $4,994 
$4,995 to $6,994 
$6,995 to $9,994 
$9,995 and over 
YYY Not specified 
RRR No budget available 



37 


51 


88 


63 


123 


186 


64 


121 


185 


51 


74 


125 


30 


27 


57 


4 


7 


11 


2 


11 


13 



XXIII 



54-55/ Per cent indirect costs 



As per cent of salaries 
and wages 



30% or less 


38 


54 


92 


31% to 40% 


34 


47 


81 


41% to 50% 


34 


55 


89 


51% to 92% 


42 


58 


100 


As per cent of total 








direct costs 








15% or less 


31 


43 


74 


16% to 30% 


32 


59 


91 


31% to 50% 


1^ 


14 


28 


51% to 77% 


4 


5 


9 


Base for indirect cost 








56/ 1 Salaries and v;ages 


148 


214 


362 


2 Sub-total direct costs 


81 


121 


202 


Y Not specified 


20 


68 


88 


R No budget available 


2 


11 


13 



O 

ERIC 



BUDGET 


(Continued) 


Funded 


Not 

Funded 


Total 


XXX XI 


57-60/ Federal funds requested 

$210 to $4,994 


29 


44 


73 




$4,995 to $7,994 


41 


80 


121 




$7,995 to $9,494 


48 


72 


120 




$9,495 to $9,894 


38 


70 


lOS 




$9,895 to $9,994 


51 


63 


114 




$9,995 to $10,000 


44 


84 


128 




YYYY Not specified 


- 


1 


1 


XXIII 


66-67/ Per cent local contribution 

10% or less 


45 


93 


138 




11% to 20% 


51 


96 


147 




21% to 30% 


51 


52 


103 




31% to 45% 


42 


79 


121 




46% to 96% 


35 


40 


75 




YY Not specified 


27 


54 


81 



PROJECT DIRECTOR'S TIME 

XXXIII 68-69/ Per cent time to be 
devoted to project 



LENGTH OF PROPOSAL 

XXIII 70-71/ Number of pages in proposal, 
single spaced, excluding 
budget and any appendices 



ONE OR MORE APPENDICES 



XXIII 


72/ 


1 


Yes 


133 


199 


332 






2 


No 


112 


204 


316 






R,Y 


Not recorded 


6 


11 


17 



RESPONDENT CONTROL 


VARIABLES 








U 


Cooperating 


institution : 








XXV 


75/ 


1 


College or university 


222 


338 


560 






2 


State Department of 














Education 


4 


5 


9 






3 


School system 


18 


48 


66 






4 


Private agency 


7 


17 


24 






9 


Individual or other (.e.g. 














educational association) 


- 


6 


6 



ERIC 



?o Subdivision: 





Not 




Funded 


Funded 


Total 



XXV 



XXV 



XXV 



37/ 


1 


education 


100 


164 


264 




3 


Research institute or bureau 


12 


12 


24 




5 


Both education and research 












institute 


8 


6 


14 


Liberal 


Arts Subdivision: 








7,0 / 


1 


Psychology 


26 


20 


46 




2 


Sociology 


8 


12 


20 




3 


Other social science 


16 


20 


36 




4 


Math, physical or bio- 












logical science 


9 


21 


30 




5 


English and language arts 


12 


25 


37 




6 


Music and art 


4 


14 


13 




7 


Liberal arts - NEC 


4 


- 


4 




Y 


Department not specified 


2 


3 


5 


Other Subdivision: 








39/ 


3 


Professional school 


2 


O 

L* 


4 




4 


Engineering; applied science 


7 


4 


11 




5 


Library and languages 


5 


1 


6 




6 


Music and art 


3 


7 


10 




7 


Administrative officer 


12 


27 


39 




8 


Vocational and applied arts 


6 


5 


11 




9 


Audio-visual 


1 


1 


■ 2 




0 


Physical education 


5 


7 


12 


37/ 


Y 


Subdivision not specified 


- 


1 


1 




X 


DNA: Not in higher education 


29 


75 


104 






(271) 


(427) 


(698) 



3. Status 



Student working toward: 



XXV 41/ 1 Master's 


1 


8 


9 


2 Ed.D. 


28 


43 


71 


3 Ph.D. 


47 


74 


121 


X Not a student 


175 


289 


464 


4. Research for dissertation: 








42/2 Yes, Ed.D. 


27 


44 


71 


3 Yes, Ph.Dc 


45 


69 


il4 


X Not for dissertation 


CO 


296 


474 


Y No answer 


1 


5 


6 




o 

ERIC 



Funded 



5. Position: (see Appendix A for classi- 

fication of position.) 



XXV 44-45/ 



0 

1 



Research director 



Faculty 

r 


(F) 


(NF)] 


[Prof, 


43 


64 ] 


[Assoc, 


46 


67 ] 


[Ass ’ t. 


54 


89 ] 


[Other 


10 


17 ] 



16 

153 



6. NJajor field 
Education : 



(XV 



XXV 



XXV 






32 V 



Not 

Funded 



28 

237 



Total 



44 

390 



2 


Student assistant or fellow 


5 


19 


24 


3 


Administrative officer 


11 


30 


41 


4 


Program director 


10 


22 


32 


5 


Counselor or consult- nx. 


7 


17 


24 


7 


Teacher 


11 


22 


33 


8 


School administrator 


2 


6 


8 


Y 


No answer 


1 


1 


2 


X 


DNA: Not employed 


35 


32 


67 



47/ 1 


Administration 


31 


47 


78 


2 


Curriculum 


15 


40 


55 


3 


Research and statistics 


11 


23 


34 


4 


Teacher training 


57 


85 


142 


5 


Instructional technology 




6 


11 


6 


Special education (e.g., 
adult, business) 


/ 


21 


28 


7 


Teacher - below college 
level 


1 


12 


13 


Psychology : 


48/1 1 


Developmental 


11 


9 


20 


2 


Guidance and counseling 


19 


29 


48 


3 


Learning 


13 


10 


23 


4 


Personality 


4 


5 


9 


5 


Testing and measurement 


3 


4 


7 


6 


Educational 


7 


7 


14 


7 


Clinical 


3 


4 


7 


9 


Other (e.g., social, 
experimental) 


5 


10 


15 


Social Science: 

49/ 1 History 


3 


9 


12 


2 


Political science 


5 


5 


10 


3 


Sociology 


10 


15 


25 


9 


Other (e.g., anthropology, 
economi cs) 


8 


19 


27 



MAJOR FIELD (continued) 


Funded 


Not 

Funded 


Total 


XXV 


Other field or specialty: 

49/ 4 Math; physical, bio- 

logical sciences 


12 


22 

18 


34 




5 English and language ;i.rts 


15 


33 




6 Music and art 


4 


11 


15 




X Professions (Cog., medicine 
nursing, law) 


2 


3 


5 


7. 

XXV 


Previous grant 

51/1 One or more grants 


140 


267 


407 




0 No granc received 


108 


141 


249 




Y No answer 


3 


6 


9 



8r Sex 

XXV S7/1 Male 

2 Female 



9. Highest degree 



XXV 



5S/1 Ph.D. in Discipline 

2 PhcD. in Education 

3 Ed.D. 

4 M.Ed.D. 

5 M.A. or M.S. in Education 

6 M.A. or M,S. in Discipline 

7 Other doctorate or pro es- 

sional degree 

8 B.A. or B.S. 

Y No vitae available 



203 

48 



69 

28 

45 

18 

26 

50 

6 

9 



347 

67 



92 

55 

67 

30 

73 

66 

8 

18 

5 



550 

115 



161 

S3 

112 

43 

99 

116 

14 

27 

5 



O 

ERIC 



PROPOSAL CONTENT 
(Non-Respondent Section) 






I 

L 




32d 



Code for 



Proposals 


Submitted to USOE Regional 


Research Program in FY 


'68 










Not 










Funded 


Funded 


To- 


GROUP TO 


BE 


STUDIED 








XXIV 8/ 


1 


Community 


- 


5 


5 


XXII 8/ 


1 


Explicit sample size 


- 


4 


4 




2 


Approx.'.mate sample size 


- 


- 


- 




Y 


Not specified 


- 


1 




9-13/ 


Nu/nber of cases in sample : 












One 




4 


4 






Two 


- 


- 


- 






Five 




- 


- 






Fourteen 


- 


- 


- 






Thirty-five 


- 


- 




YYYYY 


Not specified 


- 


1 


1 



XXIV 9/ 


1 


P arents 


- 


4 


4 


XXII 14/ 


1 


Explicit sample size 




2 


2 




2 


Approximate sample size 


- 


1 


1 




Y 


Not specified 


- 


1 


T 

J. 


15-19/ 


Number of cases in sample: 












Ti^o 




1 


1 






Fifty 


- 


1 


1 






One hundred 


- 


- 


- 






Three hundred 


- 


1 


1 


YYYYY 


Not specified 




1 


1 


XXIV 10/ 


1 


School Board 


1 




1 


XXII 20/ 


1 


Explicit sample size 




— 


- 




2 


Approximate sample size 


- 


- 


- 




Y 


Not specified 


1 


- 


1 




XXIV 


11/ 1 


School District 


Funded 

1 


Not 

Funded 


Total 

1 


XXII 


26/ 1 


Explicit sample size 


- 


- 


- 




2 


Approximate sample size 






1 




V 


Not specified 


1 





XXIV 


12/ 


1 


School 


3 


9 


12 


XXII 


32/ 


1 


Explicit sample size 


1 


5 


6 






2 


Approximate sample size 


1 


1 


2 






Y 


Not specified 


1 


5 


4 


31'. 


-37/ 


Number of cases in sample : 














1 or 2 


1 


1 


2 








3 or 4 


- 


1 


1 








6 to 12 


- 


- 


-• 








20 to 60 


1 


2 


3 








85 to 209 


- 


2 


2 




YYYYY 


Not specified 




3 


4 



XXIV 


13/ 


1 


Principals 


1 


2 


3 


XXII 


38/ 


1 


Explicit sample size 




• 








2 


Appi'oxiinate sample size 




1 


1 






Y 


Not specified 


1 


1 


2 


39 


-43/ 


Number of cases in sample : 














6 




- 










16 


- 


- 


- 








40 


- 


1 


1 








800 


- 


- 


- 




YYYYY 


Not specified 


1 


1 


2 



o 

ERIC 



^ V r 'f y 

J _i. 











Not 










Funded 


Funded 


Total 


XXIV 14/ 


1 


Other administrators 


1 


4 


5 


XXII 44/ 


1 


Explicit sample size 




1 


1 




2 


Approximate sample size 


- 


- 


- 




Y 


Not specified 


1 


5 


4 


45-49/ 


Number of cases in sample: 












20 




1 


1 






75 to 150 


- 


- 


- 






152 to 208 


- 


- 


- 






300 to iOOO 


- 


- 


- 


YYYYY 


Not specified 


1 


3 


4 



XXIV 15/ 1 


Students 


17 


70 


87 


XXII 50/ 1 


Explicit sample size 


4 


25 


29 


O 


Approximate sampl? size 


8 


22 


39 


R,Y 


Not specified 


5 


23 


28 


51-55/ Number of cases in sample: 










6 to 50 


n 


9 


11 




51 to 100 


d 


9 


15 




101 to 200 


1 

X 


16 


17 




201 to 500 


4 


9 


13 




501 to 1000 


1 


3 


4 




5000 to 22000 


- 


- 


- 


YYYYY 


Not specified 


5 


24 


29 



XXIV 16/ 


1 


Teachers 


6 


14 


20 


XXil 55/ 


1 


Explicit sample size 


- 


7 


7 




2 


Approximate sample size 


4 


2 


6 




Y 


Not specified 


2 


5 


7 


57-61/ 


Number of cases in sample. 












5 to 50 




4 


4 






51 to 150 


1 


4 


5 






200 to 600 


1 


- 


1 






1200 to 3500 


2 


1 


3 


YYYYY 


Not specified 


2 


5 


7 



o 

ERIC 













Not 










Funded 


Funded 


Total 


XXiV 7/ 


I 


Guidance counselors 


- 


2 


2 


XXII 62/ 


I 


Explicit sample size 


- 


•• 


- 




2 


Approximate sample size 


- 




O 




Y 


Not specified 


•• 


2 





\ 



XXIV 


17/ 


1 


Othp'.: (e.g., employers. 


1 


13 


14 








citizens, taxpayers) 








XXII 


68/ 


1 


Explicit sample size 


1 


5 


6 






2 


Approximate sample size 


- 


3 


3 






Y 


Not specified 


- 


5 


5 


69 


-73/ 


Number of cases in sample: 














1 to 20 




3 


3 








21 to 70 


1 


2 


3 








1500 ^ 


- 


1 


1 








5000-5500 




2 


2 




YYYYY 


Not specified 




5 


5 


XXIV 


18/ 


V 

A 


Not applicable 


4 


45 


49 



If Students 


tc 


1 be Studied ; 








XXIV 20/ 


Ca) 

1 


Race or ethnic group: 
Caucasian 


2 


6 


S 


21/ 


1 


Negro 


2 


6 


8 


22/ 


1 


Oriental 


1 


- 


1 


23/ 


1 


American Indian 


- 


1 


1 


24/ 


1 


Chinese 


- 


- 


- 


25/ 


1 


Japanese 


- 


1 


1 


26/ 


1 


Mexi c an - Arne ri c an 


- 


o 

C. 


2 


27/ 


1 


Foreign - other 


- 


4 


4 


28/ 


1 


Not specified 


16 


62 


78 


29/ 


1 


Not applicable 


11 


72 


83 






32 


154 


186 




^ f 









If Students to be Studied (continued) 



Funded 



Not 

Funded 



Total 



(b) Economic group: 



av 



32/ 


1 


Welfare or poverty 


33/ 


1 


Low income 


34/ 


1 


Middle income 


35/ 


1 


Upper income 


56/ 


1 


Not specified 


37/ 


1 


Not applicable 



1 

16 

11 



6 

5 

4 

2 

63 

72 



8 

5 

5 

2 

79 

85 



Si B..TECT MATTER 



XXII 76/ 1 

2 

3 

4 

5 



✓ 

o 



7 

8 
o 

0 



Agriculture 

Art (manual — graphics , 
painting, sculpture) 

Building design 
Business 

Education (administration, 
finance, history of, philos- 
ophy of; teacher training) 
English (rhetorical arts-- 
cinema, literature, speech, 
theatre) 

Foreign languages and 
linguistics 
Home economics 
Industrial arts 
Information processing (data 
retrieval systems, library) 



1 

6 

4 

1 



1 



77/ 1 

2 

3 

4 

5 



6 

7 

8 



Mathematics and statistics 2 

Music - 

Physical education, health, 
and recreation (dancing) 
Physiological measurements 
Psychology (educational, 

personality, school, testing 
and measurement, counseling, 
guidance and placement) 6 

Reading 1 

Science (biological, environ- 
mental, or physical) 

Social science (area studies , 
economics, geography, history, 
international relations, 
political science) 1 




^)0 



42 




42 4S 

5 6 

5 5 

11 



12 



Funded 


Not 

Funded 


Total 


SUBJECT MATTER (continued) 


9 Speech pathology and audiology 


- 


- 


- 


Y Behavioral science research , 
environmental focus 


4 


4 


8 


0 Subject not elsewhere classified 
(e.g. ,Fleadstart, aviation) 


2 


4 


6 


X Not classifiable by subject 
(e.g., student activism) 




1 


1 


30 


151 


181 


INSTRUCTIONAL METHODS 


XXI T 78/ 1 Computer assisted 


2 


1 


3 


2 Programmed 


- 


4 


4 


3 Audio-visual 


- 


0 


9 


Y No instructional method 
indicated 


_ 


3 


3 


X Not applicable 


28 


130 


15S 



EDUCATIONAL LEVEL (S) TO BE STUDIED 








XXIV 39/ 


1 


Pre-school 


2 


5 


7 


40/ 


1 


Elementary (grade specified 












below) 


13 


26 


39 


41/ 


T 

X 


Secondary (grade specified 












below) 


5 


23 


28 


42/ 


1 


Junior college (grade 












specified below) 


- 


6 


6 


43/ 


1 


College (grade specified 












below) 


8 


45 


53 


44/ 


1 


Graduate 


n 

X. 


5 


7 


45/ 


1 


Entire school system 


1 


1 


2 


46/ 


1 


Vocational and 












Applied Arts 


- 


5 


5 


48/ 


1 


Not specified 


3 


16 


19 


49/ 


1 


Does not apply 


1 

35 


23 

155 


24 

190 











Not 










Funded 


Funded 


Total 


EXPLICIT GRADE (S) TO BE STUDIED 








XXIV 51/ 


1 


All primary grades (1-6) 








52/ 


1 


First 


7 


4 


6 


53/ 


1 


Second 


1 


2 


3 


54/ 


1 


Tnird 


1 


3 


4 


55/ 


1 


Fourth 


1 


9 


10 


56/ 


1 


Fifth 


o 


S 


10 


57/ 


1 


Sixth 


3 


7 


10 


58/ 


1 


Seventh 


2 


7 


9 


59/ 


1 


Eighth 


2 


4 


6 


60/ 


1 


Ninth 


3 


5 


S 


62/ 


1 


Tenth 


1 


5 


6 


63/ 


1 


Eleventh 


1 


5 


6 


64/ 


1 


Twelfth 


1 


5 


6 


65/ 


1 

X 


All secondary grades (7-12) 


- 


- 


- 


66/ 


1 


Freshman (college) 


2 


10 


12 


67/ 


1 


Sophomove (college) 


- 


2 


2 


68/ 


1 


Junior (college) 


- 


3 


3 


69/ 


1 


Senior (college) 


- 


3 


3 


70/ 


1 


Elementary grade not specified 


8 


30 


38 


71/ 


1 


Higher grade not specified 


12 


67 


79 


72/ 


1 


Elementary grades not 












applicable 


il 


91 


102 


73/ 


1 


Higher grades not applicable 


13 


58 


71 








66 


S2o 


394 



STUDY DESIGN, METHODOLOGY 



XXV 



8 / 1 
9/ 1 

10 / 1 
11 / 1 

12 / 1 
13/ 1 

14/ 1 

15/ 1 

16/ 1 

17/ 1 

18/ 1 
19/ 1 



Developmental (not research, 
per se) 

Documentary (content analysis 
of data collected for other 
purposes) 

Experiment, quasi -experiment 
Participant and non -partici- 
pant observation 
Secondary analysis 
Sociometry 

Standardized achievement or 
psychological tests 
Survey (questionnaires , inter- 
views, etc,) 

Tests developed for study 
(aptitude, personality, 
achievement, etc.) 

Other (e,g,, follow-up panel, 
cost-benefit) 

Not specified 
Not applicable 



5 



5 

14 

7 

1 

1 



13 



7 

1 



38 

21 

49 

23 

5 

4 
41 
48 

26 

5 
2 



43 



26 

63 

30 

6 

5 

46 

61 



33 

6 



322 




1 f- - 
u 1^’ t..' 



60 



262 












Not 










Funded 


Funded 


Total 


MODES OF ANALYSIS 








XXV 21/ 


1 


Analysis of covariance 


3 


8 


11 


22/ 


1 


Analysis of variance 


3 


21 


24 


23/ 


1 


Correlation or regression 












analysis 


1 


23 


24 


24/ 


1 


Descriptive -nonanalytic 












analysis 


2 


16 


18 


25/ 


1 


Discriminant function 












analysis 


•• 


1 


T 


26/ 


1 


Factor analysis; cluster 












analysis 






6 


27/ 


1 


Qualitative or historical 












analysis 


6 


20 


26 


28/ 


1 


Tests of significance 












(t tests, chi-square. 












nonparametric , etc.) 


3 


26 


29 


29/ 


1 


Other (e.g., item analysis. 












systems analysis, Duncan's 












Range Test) 


1 


5 


6 


30/ 


1 


Not specified 


11 


31 


42 


31/ 


1 


Not applicable 


3 


32 


35 








35 


187' 


222 



MODES OF COMPUTATION AND DATA PROCESSING 








XXIII 12/ 1 


Computer 


14 


57 


71 


9 


Other (e.g., McBee cards. 










hand tabulating) 


- 


1 


1 


Y 


Not specified 


14 


63 


77 


A 


Not applicable 


2 


24 


26 



OUTCOME OF RESEARCH 



XXIII 13/ 1 Book 

2 Part of book 
Y Not specified 



14/ Number of journal articles: 



1 

2 

3 

4 
9 



One 

Two 

Three 

Four 

Plans articles , no number 
specified 
Not specified 



4 



26 



1 

1 



3 

25 



10 14 

1 1 

136 162 



6 



7 

1 



41 44 

100 125 




33 



Y 



OUTCOME OF RESEARCH (continued) 



Funded 



Not 

Funded 



Total 



XXIII 



15/ 


1 

Y 


Research report (other than 
progress or final report) 
Not specified 


4 

26 


4 

143 


8 

169 


16/ 


1 


Dissertation 


3 


8 


X 1 


Y 


Not specified 


27 


13D 


166 


17/ 


1 


Report at professional 
meeting 


1 


5 


r 

O 



program 

Report at professional 
meeting and inservice 
educational program 
Report at professional 
meeting and other (exam- 
ples listed below) 

Inservice educational pro- 
gram and other (examples 
listed below) 

Report at professional 
meeting, inservice educa- 
tional program, and other 
(examples listed belov/) 

Other (e.g., course modifica- 
tions, historical materials, 
model for salary determina- 
tion, educational tele- 
vision program) 

No outcome specified in 

Columns 13-17 7 

Some outcome specified (at 
least one numerical punch 
in columns 13-16. If 17/1-9 
not included here, because 
appears above) 9 



12 



53 

47 



65 

54 



29 



38 



PROJECT TO BE CONDUCTED 



XXIII 



18/ 1 
2 

R,Y 



Within a research bureau 
With assistance of a 
research bureau 
Not specified 



2 

3 

25 



8 10 

8 11 

131 156 



BUDGET (AMOUNTS RECORDED IN 
TENS OF DOLLARS) 





Not 




Funded 


Funded 


Total 



Deck and column location of budget items; 



XXIII 



XXIII 



22-24/ 


Total non-professional 


25-27/ 


Employee benefits 


28-30/ 


Travel 


31-33/ 


Supplies and materials 


34-36/ 


Communications 


37-39/ 


Services (test, final report 
duplication) 


40-42/ 


Equipment 


43-45/ 


Other direct costs 


46-49/ 


Sub-total direct costs 


50-53/ 


Indirect costs 


61-65/ 


Total local contribution 


19/21/ 


Total professional 



$50 to $2,994 4 
$2,995 to $4,994 6 
$4,995 to $6,994 8 
$6,995 to $9,994 8 
$9,995 and over 

YYY Not specified - 
RRR No budget available 1 



XXIII 54-55/ Per cent indirect costs 



18 


22 


33 


39 


48 


56 


29 


37 


15 


17 


1 


2 


3 


4 



As per cent of salaries 



and wages 








30% or less 


3 


28 


31 


31% to 40% 


4 


12 


16 


41% to 50% 


5 


14 


19 


51% to 92% 


5 


21 


26 


As per cent of total 








direct costs 








15% or less 


'*) 


18 


20 


16% to 30% 


4 


20 


24 


31% to 50% 




8 


11 


51% to 77% 




3 


3 



Base for indirect cost 



XXIII 56/ 


1 


Salaries and wages 


17 


75 


92 




2 


Sub-total direct costs 


9 


49 


58 




Y 


Not specified 


3 


20 


23 




R 


No budget available 


1 


3 


4 



BUDGET (Continued) 






Not 

Funded Funded Total 

funds requested 

to $4,994 
$4,995 to $7,994 
$7,995 to $9,494 
$9,495 to $9,894 
$9,895 to $9,994 
$9,995 to $10,000 
YYYY Not specified 

XXIII 66-67/ Per cenv local contribution 



10% or less 


6 


30 


36 


11% to 20% 


9 


36 


45 


21% to 30% 


4 


23 


27 


31% to 45% 


4 


17 


21 


46% to 96% 


5 


22 


27 


YY Not specified 


2 


19 


21 



PROJECT DIRECTOR’S TIME 

XXXIII 68-69/ Per cent time to be 
devoted to project 



1 

6 

8 

4 

4 

7 



11 

12 

26 



51 

1 



12 

13 

34 

37 

37 

38 
1 



XXIII 57-60/ Federal 

$210 



LENGTH OF PROPOSAL 

XXIII 70-71/ Number of pages in proposal, 
single spaced, excluding 
budget and any appendices 



ONE OR MORE APPENDICES 



XXIII 72/ 1 Yes 

2 No 

R,Y Not recorded 



16 

14 



76 

64 

7 



92 

78 

7 



NON-RESPONDENT CONTROL VARIABLES 
1. Sex: 

XXV 57/1 Male 

2 Female 



23 114 137 

7 33 40 



T 

I 






;• ( 




Funded 



Not 

Funded 



Total 



2. Employing Institution; 
60/ 



XXV 



0 Board of Education, no 
level specified 

3 Junior high school 

4 Secondary school 

5 Research organization 

6 Junior college 



7 Four-year college 


1 


8 University 


19 


9 Teacher training institution 






(college, school or de- 






partment of education) 


3 


X Not an educational institu- 






tion 


0 


R,Y Not specified 


2 


3. Position: 






XXV 61-62/ 01 


Research director 


- 


04 


Research associate 


— 


11 


Professor 


6 


12 


Associate professor 


1 


13 


Assistant professor 


7 


14 


Instructor 


— 


15 


Lecturer 


— 


21 


Research assistant 


1 


22 


Fellow 


1 


23 


Student or graduate 






assistant 


5 


31 


Dean 


— 


32 


Department or division 






chairman 


1 


33 


Library administration 


- 


35 


General administration 






(e.g., assistant dean) 


1 


40 


Other 




Staff specialist: 




51 


Psychologist 


- 


53 


Researcher 


2 


54 


Counselor 


1 


55 


Consultant 


— 


60 


Other (e.g., system analyst) - 


Lower level (s): 




71 


Classroom teacher 


2 


81 


Principal 


— 


82 


Superintendent 


— 


90 


General administration - 






lower school (e.g., program 




supervisor or assistant 






superintendent) 


1 


RR,YY 


Mot specified 


1 



7 

1 

2 

6 

5 

22 

76 



3 

19 



9 

2 

24 

21 

20 

10 

2 

1 

2 

9 

1 

6 

2 

9 

1 



2 

4 

2 

3 



3 

1 

1 



4 

8 



7 

1 

5 

6 
5 

23 

95 



5 

21 



9 
2 

30 

22 

27 

10 

2 

2 

3 

14 

1 

7 

2 

10 
1 



2 

6 

1 

2 

3 



5 

1 

1 



5 

9 



NOTE: If more than one title listed in proposal (e.g., Professor and 

departmental chairman) the professorial rank was coded.. 



4. Highest 
XXV 64/ 









Not 








Funded 


Funded 


Total 


degre 


e: 








1 

2 


B.A. or B.S. 
f^.A. or ^1.S. 


4 

2 


10 

25 

C 


14 

27 

5 


3 

4 

5 


M.Ed. 

Ed.D. 

Ph.D. 


5 

14 


D 

18 

54 


23 

68 


6 


Other professional degree 




% 


3 




(e.g., ??.D.) 








7 


Doctor, but not degree 




*1 


3 




speci fied 


A 


0 

17 

12 


21 


8 

Y 


Doctoral candidate 
Not specified 


4 

1 


13 



5. Subdivision: 

XXV 66/ 0 Mathematics 

1 Physics and astronomy 

2 Chemistry 

4 Engineering 

5 Medical and biological 

sciences 

6 Psychology 

7 Social sciences 

8 Arts and humanities 

9 Education 

R Mot specified 
X Does not apply 

67-68/ For detailed code within sub- 
divisions, see Appendix E 
(Specialties List) . 



4 

2 

1 

2 



5 

2 

2 

2 



2 

IS 

14 

27 

59 

10 

8 



3 

22 

18 

30 

72 

11 

10 



6. Year of birth: 

XXV 70-71/ Year 

Before 1910 

1910-1919 

1920-1924 

1925-1929 

1930-1934 

1935-1939 

1940-1945 

XX, YY Not specified 



2 

3 

4 
3 
6 
3 
2 
7 



10 


12 


17 


20 


17 


21 


19 


22 


15 


21 


12 


15 


6 


8 


50 


57 



A 



PROPOSAL EVALUATION 



342 



Code for 



Proposal Evaluation 



1 . Submission date 

8-13/ Month, day and year 



Field 

Reader In-house 



2. Type of evaluation 

15/ 0 None 

1 Individual review 

2 Panel 



(70) C70) 
1405 563 
444 



3, Field Reader 

17-22/ Identification Number 

4. Date Evaluation Form mailed and returned 



24-27/ Month and day Form mailed to reviewer 



29-32/ 



Month and day Form returned to Regional Office 



5. Location of Field Reader's comments 

(a) Educational significance 

34/ 1 Page 1 

2 Pages 2-4 

Y No information 

(b) Facilities 

35/ 1 Page 1 

2 Pages 2-4 

Y No information 

(c) Personnel 

36/ 1 Page 1 

2 Pages 2-4 

Y No infomation 



146 

1627 

76 



40 

1243 

566 



61 

1599 

189 





Field 

Reader In 

5. Location of Field Reader's comments (continued) 

(d) Research design 



37/ 1 Page 1 118 

2 Pages 2-4 1620 

Y No information HI 

(e) Economic efficiency 

38/ 1 Page 1 60 

2 Pages 2-4 1592 

Y No infomiation 197 



6 . Recommendation 



40/ 1 


Approval 


628 


2 


Provisional approval 


447 


3 


Disapproval 


701 


4 


Deferral 


63 


Y 


Not indicated 


10 



7. If proposal approved or provisionally approved, 
priority: 



42/ 1 High 215 

2 342 

3 235 

4 138 

5 Low 93 

Y No priority indicated 62 

X DNA: proposal disapproved 

or deferred 264 



8. Coder's interpretation of reviewer's evaluation 



(a) Educational significance 




44/ 1 


Positive 


567 


2 


Relatively positive 


309 


3 


Equally positive and negative 


236 


4 


Relatively negative 


267 


5 


Negative 


346 


6 

7 


Reviewer unable to evaluate 
Reviewer assumes this criterion 


30 



satisfied 1 

8 Coder unable to classify reviewer's 

comments 5 

Y No answer 74 

X Reviewer's comments' irrelevant 14 







/). 



house 



205 

33 

300 

6 

19 



46 

52 

33 

16 

11 

99 

306 



101 

36 

34 

66 

90 

4 



214 

18 



r' 



Field 

Reader 



In-house 



Coder's interpretation of reviev/er's 
evaluation (continued) 

(b) Facilities 



45/ 1 Positive 


387 


68 


2 Relatively positive 


318 


32 


3 Equally positive and negative 


2 ^ 


11 


4 Relatively negative 


41 


5 


5 Negative 


39 


9 


6 Reviewer unable to evaluate 

7 Reviewer assumes this criterion 


75 


8 


satisfied 

8 Coder unable to classify reviewer's 


275 


39 


comments 


4 


1 


Y No answer 


674 


386 


X Reviev^er's comments irrelevant 
(c) Personnel 


16 


4 


46/ 1 Positive 


460 


79 


2 Relatively positive 


362 


39 


3 Equally positive and negative 


99 


22 


4 Relatively negative 


178 


30 


5 Negative 


102 


28 


6 Reviewer unable to evaluate 

7 Reviewer assumes this criterion 


131 


20 


satisfied 

8 Coder unable to classify reviewer's 


269 


40 


comments 


5 


2 


Y No answer 


216 


290 


X Reviewer's comments irrelevant 
(d) Research design 


7 


13 


47/ 1 Positive 


273 


50 


2 Relatively positive 


371 


46 


3 Equally positive and negative 


247 


38 


4 Relatively negative 


321 


57 


5 Negative 


450 


121 


6 Reviewer unable to evaluate 

7 Reviewer assumes this criterion 


43 


8 


satisfied 

8 Coder unable to classify reviewer's 


12 


1 


comments 


4 


1 


Y No answer 


96 


222 


X Reviewer's comments irrelevant 


32 


19 



O 

ERIC 



345 



8. Coder's interpretation of reviewer's 
evaluation (continued) 



Field 

Reader 



(e) Economiv". efficiency 



48/ 1 

2 

3 

4 

5 

6 

7 

8 

Y 

X 



Positive 

Relatively positive 
Equally positive and negative 
Relatively negative 
Negative 

Reviewer unable to evaluate 
Reviewer assumes this criterion 
satisfied 

Coder unable to classify reviewer's 
comments 
No answer 

Reviewer's comments irrelevant 



538 

327 

87 

144 

396 

53 

2 

5 

225 

72 



In-house 



81 

44 

21 

32 

72 

14 

3 

1 

285 

10 



9. In-house reviewer 

60-72/ Last name spelled out 

74,76/ Initials of in-house reviewer, if available 



10. Type of reviewer 

78/ 1 Washington 

2 Regional office 
R Outside field reader 
No review 



1849 

70 



326 

237 



11 . Card type 

79 / 3 Evaluation 




34t 



12. Number of reviews for evaluations) 
By outside field reader: 



80/ 1 


None 

One 


2 


Two 


3 


Three 


4 


Four 


5 


Five 


6 


Six 


0 


Seven 



By in-house reviewer: 



80/ 1 


One 


8 


Two 


9 


Three 


X 


Four 


Y 


Five 



Field 

Reader In-house 



70 

643 

606 

357 

138 

99 

13 

8 



424 

120 

15 

3 

1 



347 

ERIC 



fit 



NON- RESPONDENT BACKGROUND 



Background Data - Non -Respondents Only* 



Not 







Funded 


Funded 


Tota! 


POSITION (individual responsible for 








conducting 


research. Typically, project 








director.) 


Cols 8-10 








Type of i 


affiliation : 








XXI 8/ 


0 


Board of Education, no 












level specified 


- 


7 


7 




3 


Junior high school 


- 


1 


1 




4 


Secondary school 


3 


2 


5 




5 


Research organization 


- 


6 


6 




6 


Junior college 


- 


5 


5 




7 


Four-year college 


1 


22 


23 




8 


University 


19 


76 


95 




9 


Teacher training institution 












(college, school or 












department of education) 


3 


6 


9 




X 


Net an educational institution 


2 


3 


5 




R,Y 


Not specified 


2 


19 


21 


Title : 












XXI 9-10/ 


01 


Research director 




■ 9 


9 




04 


Research associate 


- 


2 


2 




11 


Professor 


6 


24 


30 




12 


Associate professor 


1 


21 


22 




13 


Assistant professor 


7 


20 


27 




14 


Instructor 


- 


10 


10 




15 


Lecturer 


- 


2 


2 




21 


Research assistant 


1 


1 


2 




22 


Fellow 


1 


2 


3 




23 


Student or graduate assistant 


5 


9 


14 




31 


Dean 


- 


1 


1 




32 


Departmental or division 












chairman 


1 


6 


7 




33 


Library administration 


- 


2 


2 




35 


General administration 












(e.g., assistant dean) 


1 


9 


10 




40 


Other 


- 


1 


1 



*Source : Proposal submitted to USOB Regional Research Program FY '68. 




I 



34 u 



Title of Position (continued) 
Staff specialist ; 


Funded 


Not 

Funded 


Total 


51 


Psychologist 




2 


2 


53 


Researcher 


2 


4 


6 


54 


Counselor 


1 


- 


1 


55 


Consultant 


- 


2 


z 


60 


Other (e.g., system analyst) 


- 


3 


3 



Lower level (s) : 



71 


Classroom teacher 


2 


3 


5 


81 


Principal 


- 


1 


1 


82 


Superintendent 


- 


1 


1 


90 


General administration - 










lower school (e.g., program 
supervisor or assistant 
superintendent) 


1 


4 


5 



RRjYY Not specified i 8 9 

NOTE: If more than one title listed in proposal (e.g.. Professor and 

departmental chairman) the professorial rank was coded. 



BIRTHDATE 



XXI 11-12/ Day 
13-14/ Month 
15-16/ Year 



Before 1910 

1910-1919 

1920-1924 

1925-1929 

1930-1934 

1935-1939 

1940-1945 

XX, YY Not specified 



HIGHEST DEGREE 



XXI 






17/ 1 B.A. or B.S. 

2 M.A. or M.S. 

3 M.Ed. 

4 Ed.D. 

5 Ph.D. 

6 Other professional degree 

(e.g. , M.D.) 

7 Doctor, but no degree 



specified 

8 Doctoral candidate 
Y Not specified 



2 

3 

4 
3 
6 
3 
2 
7 



4 
2 

5 

14 



4 

1 



10 

17 

17 

19 

15 

12 

6 

50 



iO 

25 

5 

18 

54 

3 

3 

17 

12 



12 

20 

21 

22 

21 

15 

8 

57 



14 

27 

5 

23 

68 

3 

3 

21 

13 




y 



t { 



Not 

INSTITUTION Funded Funded Total 

XXI 18-23/ See Nash college file (BASR 
#B1050) for explicit institu- 
tional ID. For first two digits 
identify state in which institu- 
tion of higher education located. 

See Appendix C for listing of 
states . 



20-23/XXXX Other (e.g., private agency) 6 



36 42 



SUBDIVISION 

XXI 24/ 0 Mathema’tics 

1 Physics and astronomy 

2 Chemistry 

4 . Engineering 

5 Medical and biological 

sciences 

6 Psychology 

7 Social sciences 

8 Arts and humanities 

9 Education 

R Not specified 
X Does not apply 



1 

1 



1 

4 

4 

3 

13 

1 

2 



4 

2 

1 

2 

2 

18 

14 

27 

59 

10 

8 



5 

2 

2 

2 

3 

22 

18 

30 

72 

11 

10 



25-26/ For detailed code within sub- 
divisions, see Appendix E 
(Specialties List) . 



CONGRESSIONAL DISTRICT 

27-28/ Where available, recorded in 
these columns . 



SEX 



30/ 1 Male 

2 Female 



23 114 137 

7 33 40 




351 



INSTITUTIONS 



f 




352 



r 



Code for 



Institutions 
(Deck XXXXI) 

INSTITUTION Total 

1-6/ See Nash college file (BASR #81050) for 

explicit institutional ID. First two 
digits identify state in which institu- 
tion of higher education is located. 

See Appendix C for listing of states . 



HIGHEST DEGREE OFFERED* 



8/ 3 Less than four year institution 23 

4 Four or five year baccalaureate degree 

granting program 66 

5 First professional level 8 

6 Master's 118 

7 Beyond Master's but less than doctorate 41 

8 Doctorate 196 

Y No answer 13 

X DNA: Not a degree granting institution 16 

TYPE OF CONTROL* 

10/ 1 Public 244 

2 Private 210 

Y No answer 24 

X DNA: Not a degree granting institution 3 



' PJ=SP0NDENT: 




12/ 


1 


Respondent 


244 


Actual 


number of respondents : 




13/ 


1 


One 


123 




2 


Two 


63 




3 


Three 


17 




4 


Four 


14 




5 


Five 


13 




6 


Six 


2 




7 


Seven 


4 




8 


Eight 


2 




9 


Nine or more 


6 



*Source : Directoy of U.S. Institutions of Higher Education (Fall, 

1967), U.S. Department of Health^ Education, and Welfare . 
Superintendent of Documents Catalog No. FS 5.250:50052. 



IF NON -RESPONDENT: 



Total 



15/ 1 Non -respondent 

Actual number of non -respondents : 

16/ 1 One 

2 Two 

3 Three 

4 Four 

5 Five 

6 Six 

7 Seven 

8 Eight 

9 Nine or more 

Number of years received USOE Bureau of Research funds, 
1963-1967 

18/ 0 None 

1 One year 

2 Two years 

3 Three years 

4 Four years 

5 Five years 
Y No answer 

Total dollar amount of USOE Bureau of Research funds , 
1963-1967 

20-26/ No funds 

Less than $5,000 
$5,000 - $9,999 
ho, 000 - $29,999 
ho ,000 - $59,999 

$60,000 - ho ,999 

$100,000 - $249,999 
$250,000 - h09,999 
$500,000 - h09,999 
$1,000,000 - $8,850,000 

YYYYYYY Information not available 



93 



69 

16 

2 

4 

1 



83 

151 

89 

52 

33 

69 

4 



83 

28 

60 

59 

55 

44 

49 

47 

23 

29 

4 



79-80/41 



APPENDICES 



APPENDIX A 



APPLICANT POSITION 



01 Director of Research 

02 Supervisor of Research 

03 Coordinator of Research 

04 Research Associate 
06 Project Director 

10 Department Chairman 

11 Full professor 

12 Associate professor 

13 Assistant professor 

14 Instructor 

15 Lecturer 

20 Post-graduate research 

student 

21 Research Assistant 

23 Graduate Assistant 

24 Teaching Assistant 

30 Director of service unit 
51 Dean 

33 Director of Library 
35 General administration 

37 Assistant to Dean 

38 Assistant Dean 

40 Supervisor 
43 Program coordinator 

45 Director of Extension 

46 Associate director of 

special program 

47 Director of educational 

program 

49 Assistant Director special 
program 



50 Guidance, NEC 

51 Psychologist 

54 Counselor 

55 Consultant 
58 Psychiatrist 

71 Classroom teacher 

72 Teacher, special education 

73 Curriculum specialist 

74 Speech therapist 

75 Area specialist (e.g., drama) 

81 Principal 

82 Superintendent 

84 Assistant Superintendent 

85 Headmaster 



T 



1 - 




APPENDIX B 

PROFESSIONAL SOCIETIES 

001 Adult Education Association of USA 

002 American Anthropological Association 

003 American Association for the Advancement of Science 

004 American Association for Health, Physical Education and Recreation 

005 American Association for Higher Education 

006 American Association of Junior Colleges 

007 American Association of Physics Teachers 

008 American Association of School Administrators 

009 American Association of University Professors 

010 American Association on Mental Deficiency 

011 American Chemical Society 

012 American College of Sports Medicine 

013 American College Personnel and Guidance Association 

014 American Council on the Teaching of Foreign Languages 

015 American Economics Association 

016 American Educational Research Association 

017 American Ethnological Society 
^018 American Home Economics Association 

020 American Institute of Biological Sciences 

021 American Library Association 

022 American Personnel and Guidance Association 

023 American Philosophical Association 

024 American Physical Society 

025 American Political Science Association 

026 American Psychological Association 

027 American Society for Engineering Education 

028 .\merican Sociological AssociatiofA 

029 American Speech and Hearing Association 

030 American Vocational Association 

031 Association for Computing Machinery 

032 Association for Educational Data Systems 

033 Association for Institutional Research 

034 Association for Student Teaching 

035 Association for Supervision and Curriculum Development 

036 Association of Asian Studies 

037 Association of Counselor Educators and Supervisors 

038 Comparative Education Society 

039 Council for Exceptional Children 

040 Delta Pi Epsilon 

041 Department of Audio-Visual Instruction of NEA 

042 Institute of Electrical and Electronic Engineers 

043 International Reading Association 

044 International Society for ^{usic Education 

045 Kappa Delta Pi 

046 Linguistic Society of America 

047 Mathematics Association of America 

*019- American Industrial Arts Association 




A 



048 Midwest Sociological Association 

049 Modem Language Association 

050 Music Educator’s National Conference 

051 National Art Education Association 

052 National Association for Research in Science Teaching 

053 National Association of Educational Broadcasters . 

054 National Association of Geology Teachers 

055 National Association of Science Teachers 

056 National Association of Secondary School Principals 

057 National Association of Social Workers 

058 National Business Education Association 

059 National Council of Teachers of English 

060 National Council of Teachers of Mathematics 

061 National Council for Measurement in Education 

062 National Education Association 

063 National Science Teachers’ Association 

064 National Society for Programmed Instruction 

065 National Society for Study of Education 

066 Phi Delta Kappa 

067 Psychonomics Society 

068 Sigma Xi 

069 Society for Research in Child Development 

070 Society for the Psychological Study of Social Issues 

071 Society of Technical Writers and Publishers 

072 Southern Sociological Association 

073 Speech Association of America 

076 Academy of Management 

077 Acoustical Society of America 

078 American Academy of Physical Education 

079 American Academy of Religion 

080 American Association for the Advancement of Slavic Studie 

081 American Association for Design and Drafting 

082 American Association for Public Opinion Research 

083 American Association of Collegial Schools of Business 

084 American Association of Marriage Counselors 

085 American Association of Teachers of French 

086 American Bar Association 

087 American Black Psychological Association 

088 American College Art Association 

089 American Dairy Science Association 

090 American Federation of Musicians 

091 American Group Psychotherapy Association 

092 American Historical Association 

093 American Institute of Industrial Engineers 

094 American Marketing Association 

095 American Mathematical Association 

096 American Men of Science 

097 American ^^usicological Society 

098 American National Theatre and Academy 

099 American Nurses ’ Association 
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100 

101 

102 

103 

104 

105 

106 

107 

108 

109 

no 

111 

112 

113 

114 

115 

116 

117 

118 

119 

120 

121 

122 

123 

124 

125 

126 

127 

128 

129 

130 

131 

132 

133 

134 

135 

136 

137 

138 

139 

140 

141 

142 

143 

144 

145 

146 

147 

148 

149 

150 



Ame rican 
American 
American 
American 
American 
Ame rican 
American 
American Society 
American Society 



Society 

Society 

Society 

Society 

SC'Ciety 

Society 

Society 



American Orthopsychiatric Association 
American Society for Aesthetics 

for Curriculum Development 
for Ethnohistory .. 

for Testing and Materials 
for Training and Development 
of Civil Engineers 
of Electrical Engineering 
of Information Science 
of Mechanical Engineers 

of Zoologists ' 

American Statistical Association 
American Vocational Education Association 
Association for the Advancement of Medical Instrumentation 
for Education in Journalism 
for Measurement and Evaluation of Guidance 
for the Study of Negro Life and History 
of New York State Educators of the Emotionally Disturbed 
Audio Engineering Society 
Biometric Society 

California Association of School Administrators 
California Business Education Association 
California Teachers' Association 
Central Association of Science and Mathematics 
Central States Foreign Language Teachers ' Association 
Central States Speech Association 
College Art Association 
College Music Society 

Connecticut Science Teachers’ Association 



Association 

Association 

Association 

Association 



Delta Kappa Gamma 
Eastern Sociological Society 
Er“-tem Speech Association 
Econometric Society 

Educational Media Association of Canada 

Educational Research Association of New York State 

Epsilon Pi Tau 

Finno-Ugric Society 

Florida Academy of Science 

Genetics Society of America 

Geological Society of America 

IBM Common Users Group 

Idaho Academy of Science 

Illinois Council of Teachers of Mathematics 
Industrial Relations Research Association 
Institute of General Semantics 
Institute of Management Sciences 
Institute of Mathematical Statistics 
Institutional Research 

International Association for Childhood Education 
International Council of Psychologists 
International Society of Plant Morphologists 



f 

/ 

151 Kappa Phi Kappa 

152 Lutheran Education Association 

153 Midwest Economics Association 

154 Missouri State Teachers Association 

155 Mountain-Plains Philosophical Association 

156 National Association for Physical Education of College Women 

157 National Association for Retarded Children 

158 National Association of Colleges and Teachers of Agriculture 

159 National Association of Disability Examiners 

160 National Association of Geology Teachers 

161 National Association of Intergroup Relations Officials 

162 National Association of Teachers of Singing 

163 National Association of Women Deans and Counselors 

164 National Audio-Visual Association 

165 National Catholic Education Association 

166 National College Physical Education Association for Men 

167 National Council of Family Relations 

168 National Council of Social Studies 

169 National Council of University Research Administrators 

170 National Elementary Principals 

171 National Parks and Recreation Society 

172 National Rehabilitation Association 

173 National Rehabilitation Counseling Association 

174 National Society for the Study of Communication 

175 National Tax Association 

176 National Theater Conference 

177 New Mexico Geological Society 

178 New York City Coaches ' Association 

179 New York City Teachers ' Association of Health and Physical Education 

180 New York State Psychological Association 

181 Oral History Association 

182 Oregon Psychological Association 

183 Organization of American Historians 

184 Phi Kappa Phi 

185 Philosophy of Education Society 

186 Population Association 

187 Public Administration Society 

188 School Science and Mathematics 

189 Shakespeare Association 

190 Sigma Delta Chi 

191 Sigma Psi 

192 Society for Applied Anthropology 

193 Society of Biblical Literature 

194 Society for Promotion of Hellenic Studies (England) 

195 Society for thf Study of Social Problems 

196 Southeaster!. .<^sycho logical Association 

197 Southern Political Science Association 

198 Southwestern Sociological Association 

199 Texas Association for Health, Physical Education and Recreation 

200 Torrey Botanical Society 

201 Vocational Rehabilitation Association 

202 Western Philosophy of Education Association 



3d0 



APPENDIX C 



STATE CODE 



10 


Alabama 


27 


Kentucky 


44 


North Dakota 


11 


Alaska 


28 


Louisiana 


45 


Ohio 


12 


Arizona 


29 


Maine 


46 


Oklahoma 


13 


Arkansas 


30 


Maryland 


47 


Oregon 


14 


California 


31 


Massachusetts 


48 


Pennsylvania 


15 


Colorado 


32 


Mi chigan 


49 


Rhode Island 


16 


Connecticut 


33 


Minnesota 


50 


South Carolina 


17 


Delaware 


34 


Mississippi 


51 


South Dakota 


18 


District of Columbia 


35 


Missouri 


52 


Tennessee 


19 


Florida 


36 


Montana 


53 


Texas 


20 


Georgia 


37 


Nebraska 


54 


Utah 


21 


Hawaii 


38 


Nevada 


55 


Vermont 


22 


Idaho 


39 


New Hampshire 


56 


Virginia 


23 


Illinois 


40 


New Jersey 


57 


Washington 


24 


Indiana 


41 


New Mexico 


58 


West Virginia 


25 


Iowa 


42 


New York 


59 


Wisconsin 


26 


Kansas 


43 


North Carolina 


60 


Wyoming 










70 


Foreign 



APPENDIX D 



MAJOR FIELD 



Mapped 

location 


Punch 




(4) 


01 


Psychology 


(5) 


02 


Sociology 


(5) 


03 


Other Social Science (e.g., Anthropology, Economics 
History) 


(9) 


04 


Profession (Engineering, Medicine, Library Science) 


(6) 


05 


Physical Science 


(6) 


06 


Mathematics, Computer Science 


(6) 


07 


Biological Science 


(7) 


08 


English and Literature 


(7) 


09 


Foreign Language 


(7) 


10 


Dramatic Arts 


(8) 


11 


Fine Arts or Music 


(3) 


12 


Vocational and Industrial Arts 


(3) 


13 


Agriculture or Home Economics 


(1) 


14 


Teacher Training and Methodology 


(1) 


15 


Health and Physical Education 


(7) 


16 


Liberal Arts , not specified 


(1) 


17 


Education, not specified 


(1) 


18 


Curriculum 


(4) 


19 


Guidance and Counseling 


(1) 


20 


Elementary Education 


(1) 


21 


Comparative Education 


(4) 


22 


Educational Psychology 



ERIC 
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Mapped 

location Punch 



(8) 


23 


Art or Music Education 


(6) 


24 


Science Education 


(7) 


25 


Language Education 


C7) 


26 


Religious Education 


(2) 


27 


Educational Administration 


(2) 


28 


Higher Education 


C7) 


29 


Theology 


(1) 


30 


Secondary Education 


(6) 


31 


Earth Science 


(9) 


32 


Management 


(5) 


33 


Social Work 


(4) 


34 


Hum;an Development 


(7) 


36 


Philosophy 


(1) 


37 


Special Education 


(3) 


38 


Agricultural Education 


(1) 


39 


Teaching, not specified 


(7) 


40 


Speech Education 


(1) 


41 


Audio-visual Education 


(8) 


42 


Architecture, City Planning 






Dual Majors 


(4) 


59 


Engineering and Psychology 


(4) 


60 


Counseling and Educational Psychology 


(7) 


61 


Philosophy and Psychology 


(6) 


62 


Mathematics and Physics 


(1) 


63 


Elementary Education and English 



Mapped 

location Punch 



(2) 


64 


Administration and Guidance 


(1) 


65 


Education and History 


(5) 


66 


Economics and Sociology 


(8) 


67 


Art and English 


(4) 


68 


Guidance and Psychology 


(7) 


69 


English and History 


(4) 


70 


Education and Psychology 


(1) 


71 


Education and Social Science 


(6) 


72 


Biology and Physical Science 


(8) 


73 


Music and Music Education 


(5) 


74 


Industrial Relations and Sociology 


(4) 


75 


Physical Education and Psychology 


(7) 


76 


Journalism and Speech 


C8) 


77 


History and Music 


CD 


78 


Physical Education ?nd Secondary Education 


CD 


79 


Curriculum and Psychology 


(5) 


80 


Business Administration and Economics 


(7) 


81 


Counseling and Theology 


(5) 


82 


Education and Sociology 


(5) 


83 


Economics and Psychology 


CD 


84 


Curriculum and History 


CD 


85 


Curriculum and Supervision 


(4) 


86 


Psychology and Speech 


(5) 


87 


Political Science and Sociology 
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APPENDIX E 



SURVEY OF EARNED DOCTORATES 



Mathematics 

000 — Alj'fbra 
010— Analysis 
0110 — Cl CO me try 
OiJO — Lof'ic 

O'* 0— Number Theory 
050 — Probability, Math Slat. 

(.see al.so 5'i‘l, G70, 725, 920) 

0(30 — Topology 

080 — Computing Theory & Practice 
085 — Applied Mathematics 

098 — Mathematics, General 

099 — Mathematics, Other 

(note also 984: Math Educ.) 



Physics and Astronomy 

(Note: Theoretical seientists mark “T” 
on questionnaire following code No.) 

lOO — Astronomy 

110 — Atomic & Molec. Physics 

120 — Electromagnetism 

180 — Mechanics 

132 — Acoustics 

134— Fluids 

136 — Optics 

138 — Thermal Physics 

140 — Elementary Particles 

150— Nuclear Structure 

160 — Solid State 

198 — Physics, General 

199 — Physics, Other 



Chemistry 

200 — Analytical 

210 — Inorganic 

220 — Organic 

230 — Nuclear 

240 — Physical 

250 — Theoretical 

260 — Agricultural & Food 

270 — Pharmaceutical 

298 — Chemistry, General 

299 — Chemistry, Other 

(see also Biochemistry, 540) 



Earth Sciences 

300 — Mineralogy, Petrology, 
Geochemistry 

310 — Stratig.: Sedimentation 
320 — Paleontology 
330 — Structural Geology 
340 — Solid Karlli Geophysics 
350 — Geomorpli., Glacial Geology 
3G0 — Hydiology 
370 — Oceanography 
380 — Meteorology 
390 — Api)lied (jcoI.: Gool. Engr.; 
Econ. GeoL; Petroleum Geol. 

398 — Earth Sciences, General 

399— Earth Sciences, Other 



Fields Not Elsewhere 
Gla.ssified 

899 — Sci., General; Sci., Other; 
Other General Field 



Engineering 

400 — Aeronautical & AstronauUcal 

410 — Agricultural 

420— Civil 

430 — Clicmical 

435 — Ceramic 

440 — Electrical 

445 — Electronics 

450 — Industrial 

400 — Engineering Mechanics 

405 — Engineering Physics 

470 — Mcclianical 

475 — Metallurgy & Physical Met. Engin, 
480 — Sanitary 
485 — Textile 



498 — Engineering, General 

499 — Engineering, Other 

Agricultural Sciences 

500 — Agronomy 

502 — Animal Husbandry 

504— Fish & Wildlife 

505 — Forestry 

506 — Horticulture 

503 — Agriculture, General 

509 — Agriculture, Other 

Medical Sciences 

510 — Med id 210 & Surgery 

511 — Pharmacy 

512 — Public Health 

513 — Veterinary Medicine 

514 — Hospital Administration 

518 — Medical Sciences, General 

519 — Medical Sciences, Other 

Biological Sciences 

520 — Anatomy 
522 — Cytology 
524 — Embryology 

530 — Pliysiology, Animal 
532 — Physiology, Plant 
534 — Pathology 
53G — Pharmacology 
540 — Biochemistry 
542 — Biophysics 
544 — Biometrics, Biostatistics 
• (see also 050, 670, 725, 920) 

550 — Botany 
552 — Phytopathology 
5G0 — Ecology 
,582 — Ezitomology 
570 — Genetics 
562 — Hydrobiology 
5G4 — Microbiology 
580 — Zoology 

598 — Bio-Science, General 

599 — Bio-Science, Other 

Psychology 

GOO — Clinical 

610 — Counseling & Guidance 

020 — DcvclopinciUal & Gerontological 

G30 — Educational 

641 — Experimental 

642 — Comparative 

643 — Physiological 

650— Industrial & Personnel 

600 — Personality ^ 

G70 — P.svcliometrics 

(.see also 050, 544, 920) 

G:1, 5— School Psychology 
GBO — Social 

698 — Psychology, General 
G99— -Pfiycltology, Other 



Social Sciences 

700 — Ant h ropology 
705 — Archeology 

745— Area Studies (specify area) 

720 — I'k'onomics 
725 — Econometrics 

(sec also 050, 544, 670, 920) 

727 — Slat .sties 

730 — History 

740— Geography 

755 — International Relation.s 

750 — Political Science, Public Admin, 

760 — Social Work 
710 — Sociology 

798 — Social Sciences, General 

799 — Social Sciences, Other 

Arts (S: Humanities 

800 — Art, Fine & Applied (incl. hist. 

& cril.) 

SIO — Eng. & Amer. 

820 — Modern Foreign, unspcc. 

821 — German 

822 — Classical (specify) 

823 — French 

824 — Sptutisli .S: Portuguese 

825 — Linguistics 

826 — Italian 

827 — Russian 

828 — Ollier Slavic 

829 — All other modern lang. 

830 — Music 

840 — Philosophy 

815 — Speech & Dramatic Arts 

888 — Arts & Humanities, General cr School 

889 — Arts & Humanities, Other 

Prof. Fields Not Listed Above 
85D — Bu.siness Administration 
855 — Home Economics 
860 — Journalism 
865 — Law, Jurisprudence 
870 — Library Arehival Science 
880 — Religion & Theology 

Education 

Note: For fields 900 -947 and 960-967 
final digit indicates levf?";' 0 — unspeci- 
fied; 1 — preschool; 2 — o-Iti..., 3 — secon- 
dary; 4 — teacher trailing; 5 — higher 
educ.; 6 — adult educ.; 7 — ether. 

505 - Educational research ctr, 
900 — Foundations: Social, Philosoph. 

908 — Elem. Educ., General 

909 — Secondary Educ., G on oral 

910 — Educational Psychology 
920 — Educ. Mens. & Stat 

930 — Educ. Admin, & Superv. 

940 — Guid.. Couns., Student Pers. 

950-959 — Special Education 
950 — Field Unspecified 
952 — Gifted 
954 — Speech 

95G — Phys. Handicapped 
958 — Eniot. & Mem. Handicapped 
9G0 — Audio-Visual Media 

Note: For fields 970-997, and 952-959 
even number is for secondary level; 
next odd number indicates other than 
secondary level. 

970 — Agric, 988 — Phys. Ed., Health 

972 — Art & Recreation 

97^1 — Business 9D0 — Science E<iuc. 

97G — English 902 — Social Sci. Educ. 

978 — Foreign L, 9il4 — Vocational Educ. 

9tS0 — 1 Ionic Ec. 99G — Other Special 
982— I ml. Arts Field • 

984— Malli 998— Educ., General or Sch. 

986 — Music 999 — Educ,, Other 



810-829 
Lang, j 
and 
Lit. 



o 

ERje 



Source: 1968 survey of earned doctorates in United States. National Science Foundation 



